-- Logs begin at Wed 2022-08-10 12:32:55 UTC, end at Wed 2022-08-10 13:46:48 UTC. -- Aug 10 13:16:47.260973 dv-cinder-836027-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 13:16:47.270930 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 13:16:47 2022] *** Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: nodename: dv-cinder-836027-5-iscsi Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: machine: x86_64 Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: clock source: unix Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: pcre jit disabled Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: detected number of CPU cores: 4 Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: current working directory: / Aug 10 13:16:47.272609 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: detected binary path: /usr/bin/uwsgi-core Aug 10 13:16:47.273355 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: your processes number limit is 47680 Aug 10 13:16:47.273355 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: your memory page size is 4096 bytes Aug 10 13:16:47.273355 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: detected max file descriptor number: 2048 Aug 10 13:16:47.273355 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: lock engine: pthread robust mutexes Aug 10 13:16:47.273355 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: thunder lock: enabled Aug 10 13:16:47.273355 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 13:16:47.273355 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 13:16:47.313168 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: Python main interpreter initialized at 0x562a0583a9c0 Aug 10 13:16:47.313168 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: python threads support enabled Aug 10 13:16:47.313168 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: your server socket listen backlog is limited to 100 connections Aug 10 13:16:47.313168 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: your mercy for graceful operations on workers is 90 seconds Aug 10 13:16:47.313591 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 13:16:47.313591 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: *** Operational MODE: preforking *** Aug 10 13:16:47.313972 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: *** uWSGI is running in multiple interpreter mode *** Aug 10 13:16:47.313972 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: spawned uWSGI master process (pid: 103479) Aug 10 13:16:47.314208 dv-cinder-836027-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 13:16:47.315722 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: spawned uWSGI worker 1 (pid: 103480, cores: 1) Aug 10 13:16:47.315722 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: spawned uWSGI worker 2 (pid: 103481, cores: 1) Aug 10 13:16:47.317597 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 13:16:47.985155 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 13:16:47.985717 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 13:16:49.087386 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:16:49.087386 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: from cryptography.utils import int_from_bytes Aug 10 13:16:49.088082 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:16:49.088082 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: from cryptography.utils import int_from_bytes Aug 10 13:16:49.090996 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:16:49.090996 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: from cryptography.utils import int_from_bytes Aug 10 13:16:49.091444 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:16:49.091444 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: from cryptography.utils import int_from_bytes Aug 10 13:16:51.645075 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:16:51.645736 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:16:51.645837 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:16:51.646180 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:16:51.646542 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:16:51.646542 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:16:51.646691 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:16:51.646818 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.646963 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:16:51.647141 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.647330 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:16:51.647493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.647589 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:16:51.647777 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.647969 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.648106 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.648300 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.648401 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.648626 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.648724 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.648953 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.649117 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.649308 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.649396 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.649612 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.649708 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.649925 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.650018 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.650280 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.650370 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-5-iscsi {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.650562 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.650649 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.650822 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.650907 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.651138 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.651223 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.651463 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-5-iscsi {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.651555 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.651764 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.651870 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.652081 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.652210 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.652392 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.652506 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.652712 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.652881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.653068 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.653343 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.653482 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.653910 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.654036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.654219 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.654412 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.654553 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.654726 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.654858 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.655036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.655166 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.655348 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.655485 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.655689 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.655834 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.656045 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.656171 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.656306 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.656427 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.656618 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.656749 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-5-iscsi {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.656926 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.657089 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.657279 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.657917 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.658116 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.658353 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.658516 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-5-iscsi {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.658836 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.658966 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.659146 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.659276 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.659459 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.659601 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.659834 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.659965 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.660157 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.660296 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.661359 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.661981 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.662094 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.662185 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.662270 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.662635 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.662712 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.662797 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.662880 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.662962 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663044 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663125 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663209 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663292 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663368 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663453 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663529 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663604 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663691 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663768 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663843 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.663923 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664005 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664082 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664170 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664247 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664321 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664396 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664600 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664744 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.664922 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.665058 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.665198 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.665383 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.665481 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.665705 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.665796 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.666029 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.666162 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.666285 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.666383 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.666540 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.666624 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.666862 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.666948 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.667185 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.667281 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.667495 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.667580 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.667803 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.667886 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.668106 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.668191 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.668412 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.668496 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.668717 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.668800 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.669040 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.669142 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.669350 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.669435 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.669657 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.669741 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.669974 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.670059 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.670289 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.670378 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.670605 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.670690 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.670910 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.671010 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.671228 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.671310 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.671548 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.671630 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.671852 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.671945 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.672169 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.672367 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.672490 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.672795 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.672971 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.673898 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.674050 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.674298 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.674574 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.674706 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.674947 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.675114 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.675252 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.675505 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.675636 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.675809 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.676115 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.676244 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.676431 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.676616 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.676736 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.677064 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.677151 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.677373 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.677623 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.677706 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.677963 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.678145 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.678268 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.678571 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.678652 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.678876 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.679010 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.679181 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.679483 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.679566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.679787 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.679965 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.680095 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.680397 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.680485 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.680712 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.680936 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.681080 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.681344 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.681437 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.681648 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.681924 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.682006 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.682241 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.682401 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.682556 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.682859 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.682940 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.683162 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.683354 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.683482 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.683787 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.683869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.684091 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.684300 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.684390 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.684699 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.684794 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.685026 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.685280 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.685365 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.685626 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.685764 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.685930 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.686246 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.686345 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.686552 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.686725 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.686857 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.687157 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.687246 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.687458 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.687708 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.687800 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.688049 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.688193 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.688351 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.688699 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.688782 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.689222 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.689310 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.689635 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.689732 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.689966 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.690164 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.690263 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.690575 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.690665 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.690883 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.691123 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.691206 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.691527 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.691612 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.691860 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.692093 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.692202 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.692519 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.692603 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.692855 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.693071 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.693226 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.693528 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.693624 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.693842 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.694029 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.694155 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.694479 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.694562 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.694792 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.694989 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.695132 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.695400 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.695484 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.695718 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.695947 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.696037 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.696346 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.696445 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.696659 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.696894 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.696978 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.697304 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.697388 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.697614 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.697859 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.697955 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.698244 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.698327 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.698564 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.698800 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.698885 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.699196 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.699292 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.699537 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.699748 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.699831 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.700163 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.700247 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.700485 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.700711 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.700794 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.701121 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.701248 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.701434 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.701738 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.701925 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.702078 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.702223 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.702388 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.702706 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.702790 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.703015 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.703183 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:16:51.703327 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.703638 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.703721 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.703951 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.704764 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.704861 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.705158 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.705335 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.705552 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.705776 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.705866 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.706089 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.706343 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.706444 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.706703 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.706869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.707013 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.707325 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.707408 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.707628 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.707854 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.707939 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.708222 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.708355 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.708532 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.708810 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.708894 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.709162 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.709261 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.709488 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.709581 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.709792 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.709875 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.710122 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.710215 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.710431 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.710523 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.710741 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.710834 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.711050 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.711141 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.711358 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.711452 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.711663 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.711748 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.711974 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.712066 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.712298 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.712397 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.712585 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.712764 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.712907 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.713078 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.713244 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.713359 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.713548 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.713704 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.713870 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.714053 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.714174 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.714373 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.714478 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.714791 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.714877 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.715101 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.715362 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.715471 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.715706 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.715847 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.716018 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.716336 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.716420 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.716646 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.716820 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.716956 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.717314 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.717411 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.717644 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.717853 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.717944 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.718256 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.718340 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.718579 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.718828 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.718946 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.719183 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.719317 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.719497 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.719823 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.720527 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.720666 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.720854 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.720975 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.721308 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.721409 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.721605 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.721912 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.722012 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.722214 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.722488 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.722589 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.722804 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.722895 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.723124 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.723245 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.723433 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.723522 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.723739 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.723832 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.724041 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.724133 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.724343 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.724436 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.724676 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.724766 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.724979 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.725105 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.725341 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.725443 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.725659 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.725760 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.725974 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.726077 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.726283 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.726375 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.726624 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.726725 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.726914 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.727015 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.727224 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.727317 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.727535 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.727629 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.727846 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.727976 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.728159 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.728463 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.728556 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.728779 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.728952 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.729122 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.729437 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.729536 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.729760 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.729917 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.730074 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.730392 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.730493 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.730700 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.730879 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.731015 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.731355 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.731457 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.731720 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.731860 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.731997 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.732317 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.732491 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.732629 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.732805 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.732945 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.733283 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.733393 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.733592 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.733796 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.733888 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.734196 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.734295 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.734512 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.734821 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.734914 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.735136 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.735341 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.735982 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.736326 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.736424 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.736640 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.736865 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.737096 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.737220 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.737405 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.737559 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.737719 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.737884 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.738050 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.738207 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.738383 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.738606 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.738701 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.738946 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.739040 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.739260 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.739347 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.739590 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.739683 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.739897 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.739983 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.740206 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.740294 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.740517 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.740604 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.740823 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.740918 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.741157 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.741260 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.741472 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.741708 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.741922 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.742077 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.742185 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.742381 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.742652 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.742751 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.742985 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.743130 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.743294 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.743594 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.743683 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.743930 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.744066 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.744225 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.744534 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.744621 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.744852 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.745077 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.745201 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.745485 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.745574 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.745788 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.745982 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.746115 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.746414 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.746515 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.746718 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.746918 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.747008 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.747311 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.747412 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.747651 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.747952 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.748042 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.748254 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.748468 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.748566 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.748872 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.749064 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.749192 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.749327 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.749507 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.749652 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.749815 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.749943 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.750122 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.750253 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.750447 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.750584 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.750758 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.750886 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.751109 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.751263 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.752200 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.752337 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.752546 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.752730 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.752908 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.753085 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.753227 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.753410 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.753537 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.753738 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.753873 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.754058 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.754199 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.754389 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.754516 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.754694 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.754877 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.755005 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.755306 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.755434 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.755838 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.755963 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.756210 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.756350 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.756527 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.756871 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.757078 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.757205 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.757374 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.757516 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.757898 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.758046 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.758172 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.758356 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.758483 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.758740 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.758881 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.759051 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.759307 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.759435 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.759644 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.759771 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.759956 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.760251 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.760380 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.760560 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.760735 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.760863 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.761184 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.761315 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.761489 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.761793 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.761920 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.762096 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.762302 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.762433 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.762690 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.762819 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.762991 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.763222 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.763343 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.763589 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.763714 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.763907 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.764036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.764246 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.764381 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.764506 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.764637 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.764792 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.764922 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.765119 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.765251 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.765460 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.765588 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.765762 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.765924 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.766097 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.766252 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.766423 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.766579 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.766793 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.766982 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.767111 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.767235 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.767390 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.767712 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.767838 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.768056 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.768194 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.768317 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.768447 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.768600 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.768736 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.768908 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.769138 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.769265 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.769401 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.769525 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.769649 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.769818 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.769939 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.770124 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.770253 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.770435 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.770571 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.770741 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.770869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.771041 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.771170 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.771347 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.771484 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.771646 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.771775 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.771957 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.772093 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.772263 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.772399 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.772562 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.772690 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.772860 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.773011 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.773192 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.773332 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.773497 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.773618 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.774160 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.774307 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.774442 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.774575 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.774708 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.774837 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.774960 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.775083 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.775215 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.775341 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.775466 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.775589 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.775720 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.775845 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.775977 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.776103 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.776226 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.776349 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.776473 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.776596 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.776728 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.776854 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.777068 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.777205 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.777330 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.777468 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.777636 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.777772 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.777942 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.778077 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.778291 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.778431 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.778814 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.778942 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.779088 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.779216 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.779408 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.779545 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.779722 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.779851 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.780023 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.780151 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.780329 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.780467 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.780636 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.780765 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.780938 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.781096 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.781264 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.781402 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.781571 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.781701 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.781872 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.781999 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.782175 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.782521 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.782678 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.782813 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.783031 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.783161 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.783409 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.783537 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.783715 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.783855 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.784018 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.784145 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.784321 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.784451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.784621 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.784749 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.784963 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.785135 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.785288 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.785416 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.785640 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.785780 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.785942 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.786068 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.786250 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.786386 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.786557 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.786684 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.786866 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.787000 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.787176 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.787312 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.787467 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.787592 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.787760 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.787896 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.788073 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.788202 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.788433 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.788568 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.788703 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.788827 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.788959 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.789159 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.789296 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.789422 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.789589 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.789716 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.789894 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.790022 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.790201 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.790326 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.790504 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.790716 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.790844 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.790966 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.791135 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.791261 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.791434 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.791569 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.791736 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.791862 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.792041 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.792169 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.792345 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.792480 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.792654 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.792783 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.792961 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.793126 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.793301 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.793437 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.793610 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.793699 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.793917 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.794034 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.794226 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.794358 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.794532 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.794660 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.794838 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.794967 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.795146 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.795276 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.795447 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.795574 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.795746 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.795872 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.796052 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.796181 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.796354 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.796482 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.796653 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.796782 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.796958 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.797154 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.797319 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.797445 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.797566 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.797701 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.797867 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.798605 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.798898 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.799028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.799210 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.799351 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.799509 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.799646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.799812 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.799942 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.800120 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.800258 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.800429 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.800559 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.800743 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.800870 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.801085 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.801229 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.801389 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.801517 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.801753 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.801880 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.802061 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.802189 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.802380 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.802515 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.802687 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.802822 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.802988 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.803123 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.803288 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.803416 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.803596 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.803723 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.803906 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.804034 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.804207 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.804335 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.804510 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.804647 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.804813 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.804942 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.805147 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.805282 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.805453 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.805589 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.805766 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.805893 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.806071 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.806198 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.806378 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.806515 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.806688 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.806810 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.807011 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.807164 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.807347 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.807489 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.807614 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.807767 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.807908 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.808086 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.808215 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.808404 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.808728 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.808857 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.809062 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.809190 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.809327 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.809452 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.809582 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.809706 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.809830 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.809963 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.810097 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.810245 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.810376 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.810557 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.810685 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.810875 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.811013 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.811177 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.811312 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.811481 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.811606 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.811793 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.811930 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.812096 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.812231 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.812411 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.812547 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.812732 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.812868 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.813115 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.813246 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.813424 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.813562 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.814326 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.814457 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.814649 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.814789 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.814971 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.815264 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.815402 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.815529 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.815651 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.815775 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.815897 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.816030 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.816170 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.816305 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.816430 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.816553 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.816722 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.816860 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.817050 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.817196 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.817361 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.817531 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.817656 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.817789 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.817957 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.818086 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.818260 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.818389 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.818581 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.818736 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.818954 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.819083 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.819214 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.819339 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.819486 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.819624 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.819805 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.819934 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.820124 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.820252 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.820457 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.820601 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.820732 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.820857 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.821054 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.821186 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.821359 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.821491 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.821662 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.821790 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.821964 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.822094 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.822277 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.822403 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.822590 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.822732 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.822898 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.823047 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.823210 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.823339 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.823518 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.823648 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.823823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.823951 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.824150 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.824279 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.824460 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.824587 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.824765 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.824892 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.825101 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.825243 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.825394 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.825522 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.825699 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.825826 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.826001 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.826139 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.826308 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.826443 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.826609 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.826740 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.826913 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.827051 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.827213 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.827341 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.827515 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.827648 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.827804 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.827942 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.828108 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.828237 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.828409 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.828545 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.828728 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.828859 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.829128 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.829800 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.830098 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.830362 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.830500 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.830615 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.830738 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.830861 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.831019 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.831145 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.831348 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.831475 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.831599 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.831732 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.831866 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.831993 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.832155 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.832284 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.832459 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.832588 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.832763 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.832900 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.833095 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.833222 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.833403 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.833532 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.833724 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.833866 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.834037 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.834166 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.834353 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.834496 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.834667 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.834809 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.834983 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.835119 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.835291 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.835420 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.835607 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.835751 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.835920 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.836056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.836235 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.836364 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.836645 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.836801 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.836952 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.837157 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.837287 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.837475 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.837887 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.838019 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.838127 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.838420 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.838555 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.838679 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.838813 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.838938 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.839064 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.839300 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.839430 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.839554 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.839688 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.839815 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.839939 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.840062 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.840187 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.840319 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.840446 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.840578 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.840735 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.840864 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.841082 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.841229 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.841396 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.841533 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.841728 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.841855 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.842054 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.842197 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.842361 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.842490 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.842668 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.842795 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.842980 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.843109 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.843286 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.843423 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.843596 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.843725 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.843907 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.844035 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.844214 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.844339 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.844521 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.844657 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.844868 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.845543 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.845784 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.845914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.846127 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.846291 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.846481 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.846614 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.846752 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.846878 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.847000 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.847133 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.847284 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.847412 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.847608 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.847791 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.847942 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.848084 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.848261 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.848389 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.848575 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.848703 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.848888 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.849077 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.849228 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.849468 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.849597 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.849781 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.849927 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.850094 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.850231 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.850424 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.850553 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.850739 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.850869 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.851062 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.851189 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.851379 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.851505 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.851698 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.851841 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.852017 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.852143 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.852321 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.852448 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.852626 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.852756 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.852936 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.853088 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.853274 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.853402 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.853580 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.853711 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.853895 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.854022 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.854200 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.854329 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.854503 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.854637 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.854807 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.854933 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.855112 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.855248 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.855418 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.855647 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.855776 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.855999 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.856128 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.856303 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.856431 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.856608 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.856744 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.856931 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.857080 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.857265 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.857403 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.857569 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.857695 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.857869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.857995 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.858180 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.858311 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.858483 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.858610 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.858785 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.858910 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.859095 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.859223 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.859402 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.859620 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.859748 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.859886 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.860013 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.860144 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.860293 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.860461 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.861291 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.861754 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.861973 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.862144 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.862467 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.863099 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.863526 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.864020 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.864380 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.864697 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869035 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869204 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869307 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869307 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869483 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869567 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869658 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869745 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869822 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869897 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.869969 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870037 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870108 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870108 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870249 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870318 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870391 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870391 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870564 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870641 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870720 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870720 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870857 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.870929 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871002 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871073 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871179 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871257 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871332 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871405 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871477 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871555 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871629 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871705 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871778 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871845 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.871920 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.872001 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.872075 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.872169 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.872253 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.872322 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.872582 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.872720 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.872871 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.873141 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.873244 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.873627 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.873739 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.873822 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.873891 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.874104 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.874281 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.874443 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.874547 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.874803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.874902 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.875128 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.875218 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.875573 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.875773 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.875944 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.876703 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.877361 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.877477 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.877563 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.877665 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.877887 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.878070 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.878210 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.878341 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.878581 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.878682 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.878877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.879031 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.879296 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.879401 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.879611 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.879708 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.879963 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.880057 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.880282 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.880674 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.881015 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.881107 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.881387 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.881577 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.881720 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.881918 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.882057 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.882331 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.882421 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.882723 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.882827 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.883080 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.883169 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.883436 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.883598 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.883791 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.883963 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.884100 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.884298 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.884500 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.884742 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.884844 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.885131 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.885278 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.885619 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.885725 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.885975 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.886113 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.886361 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.886453 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.886682 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.886780 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.887004 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.887164 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.887319 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.887627 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.887732 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.888094 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.888241 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.888340 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.888578 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.888684 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.888890 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.889070 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.889376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.889487 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.889739 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.889886 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.890039 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.890282 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.890381 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.890710 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.890921 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.891057 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.891266 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.891413 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.891710 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.892386 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.892561 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.892654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.892880 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.892974 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.893350 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.893455 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.893782 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.893885 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.894013 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.894094 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.894320 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.894413 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.894671 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.894821 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.895020 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.932332 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.932545 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.932643 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.932725 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.932725 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.932878 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.932970 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933144 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933232 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933319 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933404 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933496 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933588 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933675 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933760 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933846 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.933931 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934011 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934170 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934253 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934332 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934410 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934489 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934568 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934662 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934749 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934828 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934907 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.934992 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935089 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935169 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935256 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935336 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935426 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935506 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935593 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935679 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935768 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935848 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.935937 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936025 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936117 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936198 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936284 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936369 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936449 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936537 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936537 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936697 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936697 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936841 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.936925 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937050 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937142 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937223 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937308 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937388 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937467 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937591 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937741 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937828 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937909 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937987 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.937987 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938151 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938234 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938339 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938474 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938604 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938698 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938794 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938883 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.938952 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939025 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939093 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939328 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939449 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939564 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939743 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939832 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.939925 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940008 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940094 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940182 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940261 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940341 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940432 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940514 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940593 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940713 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940801 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940899 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.940899 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941084 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941168 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941246 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941332 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941424 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941505 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941584 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941663 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941741 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941825 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941913 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.941994 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942080 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942201 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942289 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942379 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942460 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942550 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942631 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942724 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942805 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942898 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.942985 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943066 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943145 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943232 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943364 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943516 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943653 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943743 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943823 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.943909 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944003 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944093 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944181 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944264 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944264 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944507 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944595 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944684 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944765 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944765 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944911 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.944911 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945203 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945287 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945370 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945543 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945631 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945717 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945717 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:16:51.945869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.945869 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.946534 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.946534 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.946534 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.946534 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.946534 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.946534 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.946534 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.946534 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947080 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947080 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947080 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947080 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947080 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947080 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947080 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947080 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.947646 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948227 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948227 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948227 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948227 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948227 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948227 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948227 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948227 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.948914 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.949803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.949803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.949803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.949803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.949803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.949803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.949803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.949803 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.950451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.950451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.950451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.950451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.950451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.950451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.950451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.950451 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951100 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951100 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951100 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951100 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951100 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951100 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951100 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951100 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.951654 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.952210 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.952210 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.952210 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.952210 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:16:51.952210 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:16:52.077255 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO dbcounter [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Registered counter for database nova_api Aug 10 13:16:52.101416 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_db.sqlalchemy.engines [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:16:52.102650 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO dbcounter [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Registered counter for database nova_api Aug 10 13:16:52.108052 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writer thread running {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:16:52.122919 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_db.sqlalchemy.engines [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:16:52.129950 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writer thread running {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:16:52.166910 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.context [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),372f88b7-cf72-43dd-a32b-705a4ede3130(cell1) {{(pid=103480) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 13:16:52.170832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:52.171315 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:52.172961 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:52.173934 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:52.174392 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:52.176394 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:52.178441 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO dbcounter [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Registered counter for database nova_cell0 Aug 10 13:16:52.184033 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO dbcounter [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Registered counter for database nova_cell1 Aug 10 13:16:52.185652 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.context [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),372f88b7-cf72-43dd-a32b-705a4ede3130(cell1) {{(pid=103481) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 13:16:52.190089 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_concurrency.lockutils [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:52.190561 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_concurrency.lockutils [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:52.193925 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_concurrency.lockutils [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:52.193925 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_concurrency.lockutils [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:52.194248 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_db.sqlalchemy.engines [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:16:52.194407 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_concurrency.lockutils [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:52.194648 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_db.sqlalchemy.engines [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:16:52.195400 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_concurrency.lockutils [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:52.197456 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO dbcounter [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Registered counter for database nova_cell0 Aug 10 13:16:52.200877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writer thread running {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:16:52.202442 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writer thread running {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:16:52.202916 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO dbcounter [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Registered counter for database nova_cell1 Aug 10 13:16:52.210585 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_db.sqlalchemy.engines [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:16:52.211921 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_db.sqlalchemy.engines [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:16:52.217748 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writer thread running {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:16:52.220402 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writer thread running {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:16:52.349980 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO dbcounter [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Registered counter for database nova_cell0 Aug 10 13:16:52.357164 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_db.sqlalchemy.engines [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:16:52.361668 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writer thread running {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:16:52.364317 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO dbcounter [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Registered counter for database nova_cell0 Aug 10 13:16:52.373867 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG oslo_db.sqlalchemy.engines [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:16:52.379061 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writer thread running {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:16:52.802984 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: WARNING keystonemiddleware.auth_token [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:16:52.810281 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: WARNING keystonemiddleware.auth_token [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:16:52.928263 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: WARNING keystonemiddleware.auth_token [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:16:52.935383 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: WARNING keystonemiddleware.auth_token [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:16:53.159072 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: WARNING keystonemiddleware.auth_token [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:16:53.165373 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: WARNING keystonemiddleware.auth_token [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:16:53.170875 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a0583a9c0 pid: 103480 (default app) Aug 10 13:16:53.173845 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:53.175081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002611 Aug 10 13:16:53.175512 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Wed Aug 10 13:16:53 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:53.274538 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: WARNING keystonemiddleware.auth_token [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:16:53.280840 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: WARNING keystonemiddleware.auth_token [None req-7c6563f5-6c68-41dd-9edd-16f7503a98ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:16:53.286943 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a0583a9c0 pid: 103481 (default app) Aug 10 13:18:12.615152 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:12.616308 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 10 13:18:12.616957 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:12.629275 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writing DB stats nova_api:SELECT=3 {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:12.630410 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writing DB stats nova_cell1:SELECT=3 {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:12.631260 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writing DB stats nova_cell0:SELECT=3 {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:12.632322 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:13.522748 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-cc579eac-d7b7-49ef-834c-872cebeb941a admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:13.558334 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-cc579eac-d7b7-49ef-834c-872cebeb941a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.934236 Aug 10 13:18:13.565480 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Aug 10 13:18:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:15.786540 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:15.788209 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-787df792-35f5-499d-a0d6-62faa6fd30ae None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Aug 10 13:18:15.792026 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:16.250267 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-69ae3f02-f22b-4053-9c83-64c7cf3d0400 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:16.270887 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:18:16.270887 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: warnings.warn(msg) Aug 10 13:18:16.350132 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-69ae3f02-f22b-4053-9c83-64c7cf3d0400 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.555213 Aug 10 13:18:16.350653 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:18:16.365083 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_api:SELECT=3 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:16.366029 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_cell1:SELECT=3 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:16.367461 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_cell0:SELECT=3 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:16.368378 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:16.574995 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-d1e6e487-335e-407d-8953-eb169f8615e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:16.579895 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:18:16.579895 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: warnings.warn(msg) Aug 10 13:18:16.717169 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-d1e6e487-335e-407d-8953-eb169f8615e9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.357197 Aug 10 13:18:16.718281 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Aug 10 13:18:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:18.942746 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-69ae3f02-f22b-4053-9c83-64c7cf3d0400 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:18.943774 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-69ae3f02-f22b-4053-9c83-64c7cf3d0400 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 10 13:18:18.944180 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:19.607029 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-f1dee406-db4e-4b8c-8abd-1c6d50dbbabf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "swap": 0, "ram": 512}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:19.628741 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:18:19.628741 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: warnings.warn(msg) Aug 10 13:18:19.759727 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-f1dee406-db4e-4b8c-8abd-1c6d50dbbabf admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.809125 Aug 10 13:18:19.761152 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:18:19.773693 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-45cd994a-c34d-4094-b8a1-2c21cede3ab7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:19.777152 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:18:19.777152 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: warnings.warn(msg) Aug 10 13:18:19.893313 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-45cd994a-c34d-4094-b8a1-2c21cede3ab7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123312 Aug 10 13:18:19.894077 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Aug 10 13:18:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:22.166090 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-f1dee406-db4e-4b8c-8abd-1c6d50dbbabf admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:22.167200 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-f1dee406-db4e-4b8c-8abd-1c6d50dbbabf admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 10 13:18:22.173363 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:22.568039 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-f014504a-be0f-4fc6-bf0f-66db258cef5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "ram": 1024}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:22.667056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-f014504a-be0f-4fc6-bf0f-66db258cef5a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492492 Aug 10 13:18:22.667604 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:18:22.679695 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-a4e33209-ca25-4a7b-be64-9375444c1ba3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:22.814168 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-a4e33209-ca25-4a7b-be64-9375444c1ba3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138147 Aug 10 13:18:22.814788 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Aug 10 13:18:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:25.067682 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-f014504a-be0f-4fc6-bf0f-66db258cef5a admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:25.069455 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-f014504a-be0f-4fc6-bf0f-66db258cef5a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Aug 10 13:18:25.070334 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:25.501105 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-6c2aba96-0d3e-4340-b36d-1c90163a5a32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:25.601174 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-6c2aba96-0d3e-4340-b36d-1c90163a5a32 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.523788 Aug 10 13:18:25.602432 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:18:25.616872 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-70adfaa8-a309-4491-bb5a-d6f9cd1b291b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:25.723026 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-70adfaa8-a309-4491-bb5a-d6f9cd1b291b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111482 Aug 10 13:18:25.723865 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Aug 10 13:18:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:27.956583 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-6c2aba96-0d3e-4340-b36d-1c90163a5a32 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:27.957612 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-6c2aba96-0d3e-4340-b36d-1c90163a5a32 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 10 13:18:27.958186 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:28.378937 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-f8bc5195-70ca-4129-bc70-c43305669dda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:28.455053 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-f8bc5195-70ca-4129-bc70-c43305669dda admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491162 Aug 10 13:18:28.455778 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:18:28.469144 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-fab069d0-9344-4486-bf74-d4e74253bc63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:28.556501 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-fab069d0-9344-4486-bf74-d4e74253bc63 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092177 Aug 10 13:18:28.557226 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Aug 10 13:18:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:30.793580 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-f8bc5195-70ca-4129-bc70-c43305669dda admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:30.794598 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-f8bc5195-70ca-4129-bc70-c43305669dda admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 10 13:18:30.794991 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:18:31.335991 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-a3c7af41-7f90-47bd-a895-6a4ca766e9ff admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:31.364637 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-a3c7af41-7f90-47bd-a895-6a4ca766e9ff admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.563343 Aug 10 13:18:31.365365 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Aug 10 13:18:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:18:33.663594 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-f8bc5195-70ca-4129-bc70-c43305669dda admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:33.664758 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-f8bc5195-70ca-4129-bc70-c43305669dda admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Aug 10 13:18:33.665199 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:34.110355 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-2969e242-6821-4060-b6d6-d7a5532e1df6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:34.213802 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-2969e242-6821-4060-b6d6-d7a5532e1df6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.540862 Aug 10 13:18:34.214358 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:18:34.226606 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-6e158cd5-d721-4ca2-806e-7c17b4c49980 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:34.304378 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-6e158cd5-d721-4ca2-806e-7c17b4c49980 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081349 Aug 10 13:18:34.304978 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Aug 10 13:18:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:36.536547 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-2969e242-6821-4060-b6d6-d7a5532e1df6 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:36.537605 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-2969e242-6821-4060-b6d6-d7a5532e1df6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 10 13:18:36.538010 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:36.942099 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-35f8d678-9d9e-42bd-8b3c-424a493e7e3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:37.021347 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-35f8d678-9d9e-42bd-8b3c-424a493e7e3e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.477264 Aug 10 13:18:37.021906 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:18:37.034521 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-4763eec9-7d99-48b7-9e55-28d577df49b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:37.121868 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-4763eec9-7d99-48b7-9e55-28d577df49b7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091016 Aug 10 13:18:37.122467 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Aug 10 13:18:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:39.309619 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-35f8d678-9d9e-42bd-8b3c-424a493e7e3e admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:39.311364 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-35f8d678-9d9e-42bd-8b3c-424a493e7e3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Aug 10 13:18:39.311765 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:39.733109 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-7704e995-3467-4f11-812b-6d4248f9913a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "ram": 4096, "swap": 0, "disk": 40}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:39.992615 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-7704e995-3467-4f11-812b-6d4248f9913a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.674661 Aug 10 13:18:39.993112 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:18:40.004963 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-6a1f8ab6-3a5a-4935-9a56-50b760ee6122 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:40.094712 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-6a1f8ab6-3a5a-4935-9a56-50b760ee6122 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093325 Aug 10 13:18:40.095285 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Aug 10 13:18:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:42.346290 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-7704e995-3467-4f11-812b-6d4248f9913a admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:42.347858 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-7704e995-3467-4f11-812b-6d4248f9913a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Aug 10 13:18:42.348428 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:42.858262 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-aa0d746d-6153-42e2-84d0-e354187d39c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "ram": 8192, "id": "4"}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:42.858262 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:43.370983 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-aa0d746d-6153-42e2-84d0-e354187d39c0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.015177 Aug 10 13:18:43.379556 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:18:43.384460 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-7988c4ba-9868-4d23-9dbc-aa39b854f457 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:43.504543 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-7988c4ba-9868-4d23-9dbc-aa39b854f457 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123664 Aug 10 13:18:43.505178 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Aug 10 13:18:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:45.736401 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-aa0d746d-6153-42e2-84d0-e354187d39c0 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:45.737651 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-aa0d746d-6153-42e2-84d0-e354187d39c0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001736 Aug 10 13:18:45.738202 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:18:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:18:46.183848 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-be8e4372-fc36-4b0e-8c0f-c57bf796ace6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:46.259754 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-be8e4372-fc36-4b0e-8c0f-c57bf796ace6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.515310 Aug 10 13:18:46.260426 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Aug 10 13:18:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:18:46.272894 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-adadefa7-0546-496d-a3bb-0ad94ed085d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:46.361459 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-adadefa7-0546-496d-a3bb-0ad94ed085d7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092106 Aug 10 13:18:46.373291 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Aug 10 13:18:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:19:06.905926 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-be8e4372-fc36-4b0e-8c0f-c57bf796ace6 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:06.906939 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-be8e4372-fc36-4b0e-8c0f-c57bf796ace6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 10 13:19:06.907340 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:07.292349 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-2a9d7379-1046-4a21-970f-812881c04f13 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:07.311563 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-2a9d7379-1046-4a21-970f-812881c04f13 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398393 Aug 10 13:19:07.312092 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Aug 10 13:19:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:19:08.375880 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-be8e4372-fc36-4b0e-8c0f-c57bf796ace6 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:08.376887 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-be8e4372-fc36-4b0e-8c0f-c57bf796ace6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 10 13:19:08.377349 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:08.917353 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-160a981c-d5f4-4d3f-b0ef-fc71c9ece8d5 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:08.923332 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.wsgi [None req-160a981c-d5f4-4d3f-b0ef-fc71c9ece8d5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-160a981c-d5f4-4d3f-b0ef-fc71c9ece8d5 admin admin] Request method failure captured: Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Accept: application/json Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Accept-Encoding: gzip, deflate Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Connection: keep-alive Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Content-Length: 0 Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Host: 10.222.0.40 Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Openstack-Api-Version: compute 2.90 Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Openstack-System-Scope: None Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: User-Agent: python-novaclient Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Auth-Token: gAAAAABi87BMda0X_0cGyQc2VjDSPxuS94GNnMr2SxkUCm-nh8j3X61hAU_Uj8A807T0Fv7gk5KBOyc3__in0rYJS4AgN7gOINY2vs1KMVS-EzOrYVKxlKdYahp-pI6yAoG_rSFwEQtxGezw9vXksQUd5ZZngRvHiTJngJWcdvzLfGpXhOFDQ8c Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Domain-Id: None Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Domain-Name: None Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Identity-Status: Confirmed Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Is-Admin-Project: True Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Domain-Id: default Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Domain-Name: Default Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Name: admin Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Role: member,admin,reader Aug 10 13:19:08.926609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Roles: member,admin,reader Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_55c6cff78b754392afc788fabbf074a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant: admin Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant-Name: admin Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User: admin Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Domain-Id: default Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Domain-Name: Default Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Id: 40886c602f2b4c218564e5847aed724b Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Name: admin Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: method: > Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: exception: Flavor 42 could not be found. Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: action_args: {'id': '42'} Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:19:08.928028 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:08.929009 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:08.930566 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-160a981c-d5f4-4d3f-b0ef-fc71c9ece8d5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:19:08.931819 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-160a981c-d5f4-4d3f-b0ef-fc71c9ece8d5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.411738 Aug 10 13:19:08.931819 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Aug 10 13:19:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:08.937594 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-3edc3f63-bbda-4041-83fa-4c8b49f1158e admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:08.941758 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:08.961090 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-3edc3f63-bbda-4041-83fa-4c8b49f1158e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026974 Aug 10 13:19:08.961636 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 10 13:19:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:19:08.971988 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-12bcd097-d2fe-4f30-b7d9-8806ee65a9e7 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:08.995598 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-12bcd097-d2fe-4f30-b7d9-8806ee65a9e7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027181 Aug 10 13:19:08.996141 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 10 13:19:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:19:09.009264 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-5fb2bf12-0701-4916-bb3b-85b3d408ac9b admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:09.016081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.wsgi [None req-5fb2bf12-0701-4916-bb3b-85b3d408ac9b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-5fb2bf12-0701-4916-bb3b-85b3d408ac9b admin admin] Request method failure captured: Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Accept: application/json Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Accept-Encoding: gzip, deflate Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Connection: keep-alive Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Content-Length: 0 Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Host: 10.222.0.40 Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Openstack-Api-Version: compute 2.90 Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Openstack-System-Scope: None Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: User-Agent: python-novaclient Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Auth-Token: gAAAAABi87BMda0X_0cGyQc2VjDSPxuS94GNnMr2SxkUCm-nh8j3X61hAU_Uj8A807T0Fv7gk5KBOyc3__in0rYJS4AgN7gOINY2vs1KMVS-EzOrYVKxlKdYahp-pI6yAoG_rSFwEQtxGezw9vXksQUd5ZZngRvHiTJngJWcdvzLfGpXhOFDQ8c Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Domain-Id: None Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Domain-Name: None Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Identity-Status: Confirmed Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Is-Admin-Project: True Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Domain-Id: default Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Domain-Name: Default Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Name: admin Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Role: member,admin,reader Aug 10 13:19:09.019393 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Roles: member,admin,reader Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_55c6cff78b754392afc788fabbf074a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant: admin Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant-Name: admin Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User: admin Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Domain-Id: default Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Domain-Name: Default Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Id: 40886c602f2b4c218564e5847aed724b Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Name: admin Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: method: > Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: exception: Flavor 42 could not be found. Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: action_args: {'id': '42'} Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:19:09.021103 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:09.022081 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:09.023376 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-5fb2bf12-0701-4916-bb3b-85b3d408ac9b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:19:09.024590 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-5fb2bf12-0701-4916-bb3b-85b3d408ac9b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015149 Aug 10 13:19:09.024590 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Aug 10 13:19:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:10.013077 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-12bcd097-d2fe-4f30-b7d9-8806ee65a9e7 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:10.014139 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-12bcd097-d2fe-4f30-b7d9-8806ee65a9e7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 10 13:19:10.014533 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:10.655300 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-5bff009c-3654-425d-8df1-59822112916f admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:10.660959 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.wsgi [None req-5bff009c-3654-425d-8df1-59822112916f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-5bff009c-3654-425d-8df1-59822112916f admin admin] Request method failure captured: Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Accept: application/json Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Accept-Encoding: gzip, deflate Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Connection: keep-alive Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Content-Length: 0 Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Host: 10.222.0.40 Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Openstack-Api-Version: compute 2.90 Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Openstack-System-Scope: None Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: User-Agent: python-novaclient Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Auth-Token: gAAAAABi87BN_BcNYplYW8OIW0CpC5Qvpx5qo8QtvMsVeeGdl_Kf69mRAcWnNt2cr0JvrWY-DkPkEcECaZaXGBxo8vVyVMfxVHd_PMyOP7XmG9hNZVBA9pO-3rBa0hokeOx1A-Gt727BcksUCa-XgBlllXm_LtwHqEHsPLUVIV2eaSwsRrvfDC0 Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Domain-Id: None Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Domain-Name: None Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Identity-Status: Confirmed Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Is-Admin-Project: True Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Domain-Id: default Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Domain-Name: Default Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Name: admin Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Role: member,admin,reader Aug 10 13:19:10.662493 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Roles: member,admin,reader Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_55c6cff78b754392afc788fabbf074a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant: admin Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant-Name: admin Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User: admin Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Domain-Id: default Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Domain-Name: Default Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Id: 40886c602f2b4c218564e5847aed724b Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Name: admin Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: method: > Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: exception: Flavor 84 could not be found. Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: action_args: {'id': '84'} Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:19:10.664028 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:10.664881 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.666012 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-5bff009c-3654-425d-8df1-59822112916f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:19:10.667049 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-5bff009c-3654-425d-8df1-59822112916f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.512225 Aug 10 13:19:10.667049 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Aug 10 13:19:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:10.673939 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-7f265853-e031-4eb3-b3e5-0addee5ebac7 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:10.689469 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-7f265853-e031-4eb3-b3e5-0addee5ebac7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019202 Aug 10 13:19:10.694551 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 10 13:19:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:19:10.699351 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-7958c8fb-7329-4ebc-902b-5bd2d8460d6e admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:10.714797 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-7958c8fb-7329-4ebc-902b-5bd2d8460d6e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018973 Aug 10 13:19:10.715437 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 10 13:19:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:19:10.724711 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-615222ce-8567-4a96-9090-0c36bf1b1d02 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:10.730010 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.wsgi [None req-615222ce-8567-4a96-9090-0c36bf1b1d02 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-615222ce-8567-4a96-9090-0c36bf1b1d02 admin admin] Request method failure captured: Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Accept: application/json Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Accept-Encoding: gzip, deflate Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Connection: keep-alive Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Content-Length: 0 Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Host: 10.222.0.40 Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Openstack-Api-Version: compute 2.90 Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Openstack-System-Scope: None Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: User-Agent: python-novaclient Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Auth-Token: gAAAAABi87BN_BcNYplYW8OIW0CpC5Qvpx5qo8QtvMsVeeGdl_Kf69mRAcWnNt2cr0JvrWY-DkPkEcECaZaXGBxo8vVyVMfxVHd_PMyOP7XmG9hNZVBA9pO-3rBa0hokeOx1A-Gt727BcksUCa-XgBlllXm_LtwHqEHsPLUVIV2eaSwsRrvfDC0 Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Domain-Id: None Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Domain-Name: None Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Identity-Status: Confirmed Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Is-Admin-Project: True Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Domain-Id: default Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Domain-Name: Default Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Name: admin Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Role: member,admin,reader Aug 10 13:19:10.731696 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Roles: member,admin,reader Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_55c6cff78b754392afc788fabbf074a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant: admin Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant-Name: admin Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User: admin Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Domain-Id: default Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Domain-Name: Default Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Id: 40886c602f2b4c218564e5847aed724b Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Name: admin Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: method: > Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: exception: Flavor 84 could not be found. Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: action_args: {'id': '84'} Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:19:10.733243 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:10.734225 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:10.735581 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-615222ce-8567-4a96-9090-0c36bf1b1d02 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:19:10.736805 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-615222ce-8567-4a96-9090-0c36bf1b1d02 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011969 Aug 10 13:19:10.736805 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Aug 10 13:19:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:11.703917 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-7958c8fb-7329-4ebc-902b-5bd2d8460d6e admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:11.704916 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-7958c8fb-7329-4ebc-902b-5bd2d8460d6e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 10 13:19:11.705339 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:12.223841 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-8b479278-0033-4e15-bd49-30db224b7e80 admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:12.229543 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.wsgi [None req-8b479278-0033-4e15-bd49-30db224b7e80 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-8b479278-0033-4e15-bd49-30db224b7e80 admin admin] Request method failure captured: Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Accept: application/json Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Accept-Encoding: gzip, deflate Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Connection: keep-alive Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Content-Length: 0 Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Host: 10.222.0.40 Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Openstack-Api-Version: compute 2.90 Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Openstack-System-Scope: None Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: User-Agent: python-novaclient Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Auth-Token: gAAAAABi87BP5pMrSxQgMjupBWQ3Fn3toUr7VQBN4yjdxjQpnRG9vvCquyycy4eByvXGTqDNnHLHGz_61KSOYlG0-IEXAAd4pm8lJLjZK911r4FjI2_TN1UpvBergZ0RDY8bSs_EiXHaky9AtjCE8W-u1-o7C1jfQfrbQK8628CLSlZ4eLuN0DI Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Domain-Id: None Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Domain-Name: None Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Identity-Status: Confirmed Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Is-Admin-Project: True Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Domain-Id: default Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Domain-Name: Default Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Project-Name: admin Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Role: member,admin,reader Aug 10 13:19:12.231036 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Roles: member,admin,reader Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_55c6cff78b754392afc788fabbf074a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant: admin Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-Tenant-Name: admin Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User: admin Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Domain-Id: default Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Domain-Name: Default Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Id: 40886c602f2b4c218564e5847aed724b Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: X-User-Name: admin Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: method: > Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: exception: Flavor 451 could not be found. Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: action_args: {'id': '451'} Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:19:12.232811 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:12.233823 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.235056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-8b479278-0033-4e15-bd49-30db224b7e80 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:19:12.236234 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-8b479278-0033-4e15-bd49-30db224b7e80 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391731 Aug 10 13:19:12.236234 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 10 13:19:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:12.242200 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-b8265112-6295-4f1d-8b20-1d109433dcfa admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:12.257591 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-b8265112-6295-4f1d-8b20-1d109433dcfa admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018985 Aug 10 13:19:12.258106 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 10 13:19:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:19:12.268056 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:12.283046 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018448 Aug 10 13:19:12.283609 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 10 13:19:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:19:12.292436 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-e0699a40-edd9-4ceb-9c30-1a0ead512515 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:12.297949 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.wsgi [None req-e0699a40-edd9-4ceb-9c30-1a0ead512515 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-e0699a40-edd9-4ceb-9c30-1a0ead512515 admin admin] Request method failure captured: Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Accept: application/json Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Accept-Encoding: gzip, deflate Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Connection: keep-alive Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Content-Length: 0 Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Host: 10.222.0.40 Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Openstack-Api-Version: compute 2.90 Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Openstack-System-Scope: None Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: User-Agent: python-novaclient Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Auth-Token: gAAAAABi87BP5pMrSxQgMjupBWQ3Fn3toUr7VQBN4yjdxjQpnRG9vvCquyycy4eByvXGTqDNnHLHGz_61KSOYlG0-IEXAAd4pm8lJLjZK911r4FjI2_TN1UpvBergZ0RDY8bSs_EiXHaky9AtjCE8W-u1-o7C1jfQfrbQK8628CLSlZ4eLuN0DI Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Domain-Id: None Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Domain-Name: None Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Identity-Status: Confirmed Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Is-Admin-Project: True Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Domain-Id: default Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Domain-Name: Default Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Project-Name: admin Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Role: member,admin,reader Aug 10 13:19:12.299418 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Roles: member,admin,reader Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/55c6cff78b754392afc788fabbf074a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_55c6cff78b754392afc788fabbf074a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant: admin Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant-Id: 55c6cff78b754392afc788fabbf074a6 Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-Tenant-Name: admin Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User: admin Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Domain-Id: default Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Domain-Name: Default Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Id: 40886c602f2b4c218564e5847aed724b Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: X-User-Name: admin Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: method: > Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: exception: Flavor 451 could not be found. Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: action_args: {'id': '451'} Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:19:12.300927 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:12.301832 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.302877 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-e0699a40-edd9-4ceb-9c30-1a0ead512515 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:19:12.303899 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-e0699a40-edd9-4ceb-9c30-1a0ead512515 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011735 Aug 10 13:19:12.303899 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 10 13:19:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:13.297365 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:13.298420 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 10 13:19:13.298834 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:13.823631 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-185512c8-6eb3-4b4b-ad12-9dbf9f4e3e7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:19:13.911216 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-185512c8-6eb3-4b4b-ad12-9dbf9f4e3e7b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.473599 Aug 10 13:19:13.911761 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Aug 10 13:19:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:19:14.908304 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:14.909305 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 10 13:19:14.909695 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:15.428976 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-e8059706-90d4-4cd1-9cce-c46dddcc0393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:19:15.498162 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-e8059706-90d4-4cd1-9cce-c46dddcc0393 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.452086 Aug 10 13:19:15.498611 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Aug 10 13:19:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:19:16.458417 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:16.459427 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 10 13:19:16.459824 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:19:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:16.979060 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-9582f3ec-55af-4c0f-a415-24bd0bca85cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:19:17.054784 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-9582f3ec-55af-4c0f-a415-24bd0bca85cc admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.456455 Aug 10 13:19:17.055370 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Aug 10 13:19:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:19:18.025078 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:18.026138 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 10 13:19:18.026529 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:18.548496 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-dd9ba01d-ecef-46e6-ae1f-1a9ccb872446 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:19:18.625613 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-dd9ba01d-ecef-46e6-ae1f-1a9ccb872446 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458903 Aug 10 13:19:18.626171 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Aug 10 13:19:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:19:19.596844 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:19.597874 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 10 13:19:19.598271 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:19:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:20.120671 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-5fbe46ab-db12-4d6a-8761-6cc9bf0eddfe admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:20.141480 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-5fbe46ab-db12-4d6a-8761-6cc9bf0eddfe admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404062 Aug 10 13:19:20.141952 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Wed Aug 10 13:19:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:20:11.631704 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:11.632653 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-4e4de4d5-d93c-4a12-8d8b-19136ff3ea4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 10 13:20:11.633071 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Wed Aug 10 13:20:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:20:11.643549 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:12.026966 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-6e85a7ff-01bc-428f-8541-286277be79b9 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:12.048293 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-6e85a7ff-01bc-428f-8541-286277be79b9 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409125 Aug 10 13:20:12.048834 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Aug 10 13:20:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:20:12.072171 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-6932f531-0c0e-40ce-bc05-573d6655949c admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:12.076287 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG dbcounter [-] [103481] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:12.081282 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-6932f531-0c0e-40ce-bc05-573d6655949c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012638 Aug 10 13:20:12.081798 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Wed Aug 10 13:20:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:20:12.093258 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-e4c97394-aba1-46c0-ab6a-bd1f182ec127 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:12.100859 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-e4c97394-aba1-46c0-ab6a-bd1f182ec127 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011166 Aug 10 13:20:12.101417 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Wed Aug 10 13:20:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:20:12.113104 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:12.121816 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012626 Aug 10 13:20:12.122330 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Wed Aug 10 13:20:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:12.133473 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-cdfb7920-9851-450d-9938-721ea1c10039 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:12.141955 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-cdfb7920-9851-450d-9938-721ea1c10039 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011944 Aug 10 13:20:12.142470 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Wed Aug 10 13:20:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:23:17.236791 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:23:17.237932 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 10 13:23:17.238326 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:23:17.377908 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_api:SELECT=6 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:17.536434 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-85bfc7f0-f370-4889-aa44-7c5a2ca6f94e admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:23:17.539403 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:23:17.539403 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: warnings.warn(msg) Aug 10 13:23:17.540513 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-85bfc7f0-f370-4889-aa44-7c5a2ca6f94e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:23:17.541015 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-85bfc7f0-f370-4889-aa44-7c5a2ca6f94e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:23:17.541439 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-85bfc7f0-f370-4889-aa44-7c5a2ca6f94e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:23:17.542140 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-85bfc7f0-f370-4889-aa44-7c5a2ca6f94e admin admin] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:23:17.542584 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-85bfc7f0-f370-4889-aa44-7c5a2ca6f94e admin admin] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:23:17.542998 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-85bfc7f0-f370-4889-aa44-7c5a2ca6f94e admin admin] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:23:17.577567 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-85bfc7f0-f370-4889-aa44-7c5a2ca6f94e admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201141 Aug 10 13:23:17.578142 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 10 13:23:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:23:18.410423 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:23:18.411473 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 10 13:23:18.411852 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:23:18.613675 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-a034a9fd-ffbf-47ce-a88a-d6af9beefb92 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:23:18.616086 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:23:18.616086 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: warnings.warn(msg) Aug 10 13:23:18.617401 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-a034a9fd-ffbf-47ce-a88a-d6af9beefb92 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:23:18.617885 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-a034a9fd-ffbf-47ce-a88a-d6af9beefb92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:23:18.618321 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-a034a9fd-ffbf-47ce-a88a-d6af9beefb92 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:23:18.619043 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-a034a9fd-ffbf-47ce-a88a-d6af9beefb92 admin admin] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:23:18.619502 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-a034a9fd-ffbf-47ce-a88a-d6af9beefb92 admin admin] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:23:18.619925 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-a034a9fd-ffbf-47ce-a88a-d6af9beefb92 admin admin] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:23:18.640816 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-a034a9fd-ffbf-47ce-a88a-d6af9beefb92 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078942 Aug 10 13:23:18.641419 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 10 13:23:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:23:29.888338 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:23:29.889385 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 10 13:23:29.889781 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:23:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:23:30.035201 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_cell0:SELECT=4 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:30.035922 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_cell1:SELECT=4 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:30.036537 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG dbcounter [-] [103480] Writing DB stats nova_api:SELECT=8 {{(pid=103480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:30.084554 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-608aecb2-cc6c-4c31-be67-5c0b55b1b75c admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:23:30.087690 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:23:30.087690 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: warnings.warn(msg) Aug 10 13:23:30.088763 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-608aecb2-cc6c-4c31-be67-5c0b55b1b75c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:23:30.089267 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-608aecb2-cc6c-4c31-be67-5c0b55b1b75c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:23:30.089703 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-608aecb2-cc6c-4c31-be67-5c0b55b1b75c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:23:30.090409 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-608aecb2-cc6c-4c31-be67-5c0b55b1b75c admin admin] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:23:30.090858 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-608aecb2-cc6c-4c31-be67-5c0b55b1b75c admin admin] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:23:30.091273 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-608aecb2-cc6c-4c31-be67-5c0b55b1b75c admin admin] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:23:30.117586 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-608aecb2-cc6c-4c31-be67-5c0b55b1b75c admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086837 Aug 10 13:23:30.118101 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 10 13:23:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:23:30.951843 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: DEBUG nova.api.openstack.wsgi [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] Calling method '>' {{(pid=103481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:23:30.952856 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: INFO nova.api.openstack.requestlog [None req-54da493e-b2e6-4290-94f1-b616d2bf91cb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 10 13:23:30.953293 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: [pid: 103481|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 10 13:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:23:31.146218 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG nova.api.openstack.wsgi [None req-465b305d-62e5-4650-9fed-82329f48f097 admin admin] Calling method '>' {{(pid=103480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:23:31.148973 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:23:31.148973 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: warnings.warn(msg) Aug 10 13:23:31.150289 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-465b305d-62e5-4650-9fed-82329f48f097 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:23:31.150773 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-465b305d-62e5-4650-9fed-82329f48f097 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:23:31.151211 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-465b305d-62e5-4650-9fed-82329f48f097 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:23:31.151934 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-465b305d-62e5-4650-9fed-82329f48f097 admin admin] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:23:31.152391 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-465b305d-62e5-4650-9fed-82329f48f097 admin admin] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:23:31.152818 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: DEBUG oslo_concurrency.lockutils [None req-465b305d-62e5-4650-9fed-82329f48f097 admin admin] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:23:31.175404 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: INFO nova.api.openstack.requestlog [None req-465b305d-62e5-4650-9fed-82329f48f097 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081724 Aug 10 13:23:31.175897 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: [pid: 103480|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 10 13:23:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:24:29.830080 dv-cinder-836027-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 13:24:29.830667 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: Wed Aug 10 13:24:29 2022 - graceful shutdown triggered... Aug 10 13:24:29.831184 dv-cinder-836027-5-iscsi devstack@n-api.service[103480]: Gracefully killing worker 1 (pid: 103480)... Aug 10 13:24:29.831657 dv-cinder-836027-5-iscsi devstack@n-api.service[103481]: Gracefully killing worker 2 (pid: 103481)... Aug 10 13:24:30.831813 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: worker 1 buried after 1 seconds Aug 10 13:24:30.832326 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: worker 2 buried after 1 seconds Aug 10 13:24:30.832326 dv-cinder-836027-5-iscsi devstack@n-api.service[103479]: goodbye to uWSGI. Aug 10 13:24:30.833435 dv-cinder-836027-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 13:24:30.833997 dv-cinder-836027-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 13:24:30.836947 dv-cinder-836027-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 13:24:30.846249 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 13:24:30.848794 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 13:24:30 2022] *** Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: nodename: dv-cinder-836027-5-iscsi Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: machine: x86_64 Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: clock source: unix Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: pcre jit disabled Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: detected number of CPU cores: 4 Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: current working directory: / Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: detected binary path: /usr/bin/uwsgi-core Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: your processes number limit is 47680 Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: your memory page size is 4096 bytes Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: detected max file descriptor number: 2048 Aug 10 13:24:30.848954 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: lock engine: pthread robust mutexes Aug 10 13:24:30.849822 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: thunder lock: enabled Aug 10 13:24:30.849822 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 13:24:30.849822 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 13:24:30.889322 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: Python main interpreter initialized at 0x55bd333df9c0 Aug 10 13:24:30.889322 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: python threads support enabled Aug 10 13:24:30.889322 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: your server socket listen backlog is limited to 100 connections Aug 10 13:24:30.889322 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: your mercy for graceful operations on workers is 90 seconds Aug 10 13:24:30.889721 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 13:24:30.889797 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: *** Operational MODE: preforking *** Aug 10 13:24:30.890037 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: *** uWSGI is running in multiple interpreter mode *** Aug 10 13:24:30.890037 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: spawned uWSGI master process (pid: 117986) Aug 10 13:24:30.890245 dv-cinder-836027-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 13:24:30.890772 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: spawned uWSGI worker 1 (pid: 118002, cores: 1) Aug 10 13:24:30.891255 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: spawned uWSGI worker 2 (pid: 118003, cores: 1) Aug 10 13:24:30.891522 dv-cinder-836027-5-iscsi devstack@n-api.service[117986]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 13:24:31.563147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 13:24:31.563932 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 13:24:32.720095 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:24:32.720095 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: from cryptography.utils import int_from_bytes Aug 10 13:24:32.720835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:24:32.720835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: from cryptography.utils import int_from_bytes Aug 10 13:24:32.739402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:24:32.739402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: from cryptography.utils import int_from_bytes Aug 10 13:24:32.739917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:24:32.739917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: from cryptography.utils import int_from_bytes Aug 10 13:24:35.047982 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:24:35.048669 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:24:35.048768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:24:35.049162 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:24:35.049432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:24:35.049827 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.050132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.050462 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.050787 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.051120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.051434 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.051759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.052082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.052412 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.052678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.053021 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.053354 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-5-iscsi {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.053680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.053999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.054314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.054774 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.055161 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.055485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.055796 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.056304 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.057702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.057702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.057702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.058097 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.058339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.058654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.058988 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.059320 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.059677 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.059952 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.060361 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-5-iscsi {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.060690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.061034 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.061351 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.061792 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.062099 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.062411 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.062725 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.063053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.063369 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.063716 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.064048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.064390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.064700 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.064890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:24:35.065353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.065431 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:24:35.065528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.065719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.065901 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:24:35.066055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.066221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:24:35.066399 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.066545 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:24:35.066702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.066856 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.067000 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.067152 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.067304 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.067459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.067603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.067828 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.067986 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.068139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.068283 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.068432 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.068593 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.068593 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.068914 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.069091 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.069240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.069406 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.069568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.069568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.069916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.070733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.070897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.071064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-5-iscsi {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.071239 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.071239 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.071709 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.071865 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.072018 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.072172 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.072317 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.072460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.072610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.072779 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.072936 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.073181 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.073344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.073494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.073647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.074633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.074633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.074941 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.075106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.075262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.075262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.075543 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.075543 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.075825 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.075979 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.076134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.076288 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.076440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.076596 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.076748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.076899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.077085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.077243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.077387 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.077547 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.077699 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.077853 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.078005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.078148 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.078302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-5-iscsi {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.078446 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.078588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.078742 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.078885 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.079040 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.079192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.079344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.079344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.079624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.079789 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.079995 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.080156 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.080302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.080451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.080601 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.080752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.080909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.081119 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.081268 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.081447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082561 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082632 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082708 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082787 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.082874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083012 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083096 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083269 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083358 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083700 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083878 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.083967 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084219 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084316 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084406 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084582 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084669 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.084840 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.085083 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.085236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.085411 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.085774 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.086656 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.086849 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.087054 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.087234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.087381 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.087526 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.087680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.087824 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.087977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.088129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.088282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.088435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.088578 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.088734 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.088888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.089084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.089246 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.089390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.089533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.089676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.089828 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.090015 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.090173 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.090325 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.090476 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.090630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.090795 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.090951 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.090951 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.091248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.091248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.091529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.091682 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.091834 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.091834 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.092123 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.092273 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.092425 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.092575 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.092718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.092872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.093058 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.093208 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.093419 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.093578 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.093731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.093875 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.094018 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.094167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.094419 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.094570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.094716 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.095041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.095338 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.095732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.095983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.095983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.096280 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.096424 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.096574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.096727 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.096878 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.097086 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.097249 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.097405 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.097556 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.097718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.097863 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.098016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.098168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.098323 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.098466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.098621 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.098764 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.098915 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.099058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.099202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.099344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.099503 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.099655 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.099805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.099955 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.100139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.100298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.100443 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.100597 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.100756 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.100911 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.101090 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.101250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.101439 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.101617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.101829 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.101977 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.102121 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.102277 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.102422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.102565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.102714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.102864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.103016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.103165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.103309 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.103451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.103614 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.103757 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.103907 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.104050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.104192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.104343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.104580 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.104739 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.104884 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.105199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.105485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.105869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.106116 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.106329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.106481 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.106632 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.106776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.106938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.107090 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.107234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.107384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.107539 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.107684 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.107835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.107999 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.108143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.108306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.108489 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.108652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.108806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.108965 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.109147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.109301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.109452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.109595 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.109745 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.109902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.110045 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.110236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.110236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.110538 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.110706 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.110903 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.110903 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.111190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.111341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.111485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.111636 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.111788 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.111931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.112073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.112215 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.112367 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:24:35.112523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.112675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.112819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.112970 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.113136 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.113291 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.113445 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.113596 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.113747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.113900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.114053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.114216 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.114369 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.114518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.114760 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.114912 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.115064 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.115376 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.115661 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.116040 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.116290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.116450 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.116596 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.116748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.117619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.117783 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.117940 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.118102 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.118254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.118408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.118551 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.118694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.118837 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.118980 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.119143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.119297 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.119458 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.119603 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.119792 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.119944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.120101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.120480 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.120634 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.120634 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.120916 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.121090 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.121257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.121404 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.121548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.121702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.121846 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.121997 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.122212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.122367 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.122518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.122679 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.123393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.123563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.123709 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.123860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.124004 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.124146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.124301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.124456 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.124600 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.124771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.125061 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.125216 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.125654 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.125819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.126207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.126464 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.126464 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.126763 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.126914 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.127078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.127229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.127372 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.127523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.127674 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.127827 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.127978 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.128128 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.128271 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.128420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.128565 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.128720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.128873 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.129042 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.129194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.129347 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.129491 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.129646 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.129790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.129938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.130089 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.130239 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.130431 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.130594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.130747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.130900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.131050 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.131240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.131402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.131561 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.131714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.131865 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.132016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.132159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.132314 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.132465 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.132676 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.132828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.133063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.133227 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.133381 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.133532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.133683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.134739 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.134900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.135152 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.135305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.135770 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.135930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.136361 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.136651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.136804 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.136949 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.137116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.137261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.137261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.137558 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.137709 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.137861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.138013 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.138157 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.138308 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.138553 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.138722 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.138866 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.139019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.139178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.139329 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.139479 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.139623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.139765 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.139907 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.140060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.140213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.140357 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.140545 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.140704 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.140855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.141053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.141205 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.141357 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.141500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.141643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.141794 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.141937 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.142086 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.142232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.142383 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.142537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.142694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.142837 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.142986 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.143137 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.143432 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.143606 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.143762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.143906 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.144049 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.144191 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.144335 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.144478 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.144650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.144794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.145217 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.145394 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.145562 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.146047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.146235 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.146911 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147086 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147249 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147446 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147622 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147706 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147796 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.147971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.148055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.148150 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.148779 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.148871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.148962 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149077 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149256 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149329 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149406 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149478 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149665 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.149975 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.150066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.150163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.150247 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.150330 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.150412 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.150506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.150667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151029 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151325 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151414 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151784 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151867 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.151948 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152030 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152131 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152475 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152637 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152637 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152800 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.152971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153448 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153710 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.153983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154329 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154411 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154583 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154678 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154843 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.154933 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155112 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155296 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155432 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155519 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155686 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155800 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.155963 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.156227 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.156327 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.156419 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.156576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.156675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.156814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157409 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157500 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157854 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.157946 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158037 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158121 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158291 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158291 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158455 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158724 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.158905 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159017 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159174 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159353 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159534 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159798 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.159987 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.160078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.160168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.160257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.160366 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.160525 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.160671 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.160839 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.160969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.161194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.161290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.161510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.161620 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.161821 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.161934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.162131 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.162225 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.162449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.162549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.162774 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.162871 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.163086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.163187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.163395 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.163493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.163713 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.163880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.164074 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.164239 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.164389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.164483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.164695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.164786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.165067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.165182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.165348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.165447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.165656 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.165757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.165960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.166063 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.166339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.166433 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.166599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.166702 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.166906 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.167048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.167228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.167329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.167554 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.167657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.167868 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.167973 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.168187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.168285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.168494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.168584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.168804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.168903 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.169142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.169234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.169454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.169545 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170511 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170664 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.170978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.171079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.171292 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.171391 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.171607 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.171918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.172225 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.172394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.172587 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.172759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.172912 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.173216 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.173382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.173542 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.173694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.173858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.174020 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.174170 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.174328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.174498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.174662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.174821 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.175024 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.175261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.175416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.175575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.175727 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.175887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.176045 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.176206 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.176510 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.176669 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.176835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.176987 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.177173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.177331 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.177481 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.177631 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.177792 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.177952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.178113 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.178249 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.178424 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.178512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.178595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.178678 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.178844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.178948 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.179041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.179126 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.179208 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.179290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.179918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.180183 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.180291 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.180500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.180593 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.180810 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.180919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.181193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.181300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.181504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.181607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.181818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.181917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.182129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.182258 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.182439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.182533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.182747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.182853 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.183059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.183161 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.183366 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.183482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.183673 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.183805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.183980 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.184082 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.184285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.184459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.184591 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.184775 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.184917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.185150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.185244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.185462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.185564 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.185806 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.185907 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.186139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.186237 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.186496 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.186618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.186788 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.186886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.187093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.187190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.187422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.187523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.187731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.187830 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.188040 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.188190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.188346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.188455 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.188659 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.188759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.188971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.189158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.189302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.189404 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.189617 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.189716 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.189931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.190022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.190243 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.190347 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.190550 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.190647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.190854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.190945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.191165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.191257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.191473 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.191572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.191786 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.191876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.192100 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.192190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.192407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.192506 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.192712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.192804 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.193048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.193154 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.193364 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.193456 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.193668 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.193764 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.193978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.194075 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.194281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.194371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.194592 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.194695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.194905 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.195002 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.195623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.195712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.195712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.195890 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.195982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.196065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.196286 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.196385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.196606 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.196719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.196910 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.197035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.197247 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.197339 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.197556 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.197660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.197865 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.197956 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.198181 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.198324 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.198486 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.198580 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.198792 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.198884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.199098 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.199194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.199412 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.199511 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.199719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.199812 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.200025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.200159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.200341 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.200477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.200649 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.200793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.200958 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.201126 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.201292 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.201443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.201606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.201757 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.201911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.202079 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.202218 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.202399 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.202526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.202708 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.202835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.203133 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.203225 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.203451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.203550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.203761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.203859 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.204069 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.204168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.204376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.204466 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.204684 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.204772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.205035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.205130 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.205345 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.205448 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.205658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.205857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.205950 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.206263 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.206593 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.206861 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.206955 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.207190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.207273 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.207518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.207606 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.207839 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.207920 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.208259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.208356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.208541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.208643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.209059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.209168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.209253 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.209326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.209457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.209552 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.209780 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.210222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.210373 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.211266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.211548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.211697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.211860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.211989 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.212193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.212311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.212610 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.212746 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.212848 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.212943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.213206 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.213421 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.213545 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.213747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.213876 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.214146 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.214241 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.214463 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.214562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.214781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.214881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.215102 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.215200 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.215421 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.215519 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.215739 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.215840 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.216058 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.216186 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.216376 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.216516 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.216693 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.216877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.217059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.217194 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.217344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.217500 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.217661 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.217813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.217972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.218127 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.218307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.218430 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.218622 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.218732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.218934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.219045 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.219247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.219339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.219557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.219649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.219942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.220055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.220189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.220299 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.220563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.220653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.220873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.220971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.221228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.221358 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.221556 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.221656 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.221867 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.221964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.222182 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.222271 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.222504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.222605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.222824 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.222934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.223132 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.223224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.223444 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.223541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.223774 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.223878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.224091 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.224188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.224401 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.224498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.224708 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.224807 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.225059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.225168 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.225381 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.225480 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.225702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.225799 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.226009 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.226113 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.226364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.226466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.226681 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.226794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.227011 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.227123 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.227319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.227419 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.227646 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.227737 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.228014 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.228102 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.228339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.228437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.228665 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.228773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.228974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.229149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.229303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.229468 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.229618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.229786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.230059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.230196 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.230284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.230436 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.230569 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.230765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.230867 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.231078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.231169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.231398 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.231499 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.231712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.231803 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.232039 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.232136 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.232347 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.232449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.232672 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.232762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.232983 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.233140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.233314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.233416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.233623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.233722 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.233931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.234024 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.234279 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.234371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.234588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.234720 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.234924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.235058 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.235239 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.235345 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.235568 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.235661 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.235895 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.235997 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.236219 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.236317 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.236542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.236634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.236850 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.236949 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.237192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.237297 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.237505 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.237597 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.237818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.237922 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.238159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.238268 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.238450 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.238704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.238879 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.239139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.239481 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.239631 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.239852 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.239980 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.240196 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.240333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.240482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.240600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.240798 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.240927 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.241155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.241285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.241471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.241596 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.241800 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.242441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.242652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.242770 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.243040 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.243176 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.243396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.243524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.243712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.243830 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.244043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.244168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.244359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.244487 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.244671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.244788 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.244979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.245129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.245389 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.245527 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.245712 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.245802 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.246045 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.246147 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.246397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.246498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.246728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.246827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.247042 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.247146 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.247365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.247462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.247688 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.247787 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.248011 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.248117 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.248332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.248431 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.248648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.248804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.248970 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.249178 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.249314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.249443 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.249648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.249753 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.249946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.250064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.250266 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.250355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.250585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.250684 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.250898 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.250998 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.251217 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.251307 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.251528 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.251619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.251840 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.251936 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.252153 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.252262 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.252468 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.252567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.252779 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.253025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.253296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.253404 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.253623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.253714 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.254026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.254137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.254290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.254381 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.254600 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.254698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.254919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.255008 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.255248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.255337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.255559 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.255690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.255860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.255960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.256175 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.256274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.256493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.256599 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.256801 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.256899 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.257160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.257476 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.257771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.258082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.258221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.258510 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.258606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.258700 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.258934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.259244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.259349 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.259571 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.259676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.259909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.260017 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.260238 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.260411 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.260572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.260892 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.261059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.261230 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.261601 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.261875 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.262186 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.262560 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.262686 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.262808 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.263046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.263190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.263401 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.263541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.263716 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.264029 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.264191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.264339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.264659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.264861 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.264976 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.265321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.265614 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.265870 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.265988 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.266262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.266364 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.266598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.266915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.267504 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.267504 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.267844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.267844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.268010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.268100 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.268316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.268412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.268628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.268753 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.268965 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.269137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.269281 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.269477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.269598 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.269812 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.269918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.270143 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.270244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.270475 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.270570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.270808 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.270914 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.271118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.271218 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.271449 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.271549 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.271761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.271860 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.272097 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.272268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.272442 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.272528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.272731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.272831 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.273076 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.273724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.273932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.274088 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.274247 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.274340 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.274602 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.274720 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.274926 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.275046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.275372 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.275469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.275697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.275795 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.276033 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.276146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.276382 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.276474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.276712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.276816 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.277059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.277153 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.277386 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.277487 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.277696 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.277808 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.278025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.278236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.278334 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.278560 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.278665 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.278903 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.279019 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.279236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.279339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.279547 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.279647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.279859 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.279950 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.280174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.280273 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.280487 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.280591 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.280800 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.280902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.281134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.281276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.281448 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.281767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.282152 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.282337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.282543 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.282638 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.282956 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.283050 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.283302 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.283557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.283649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.283936 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.284049 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.284255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.284543 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.284641 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.284879 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.285153 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.285272 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.285518 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.285741 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.286317 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.286623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.286808 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.286974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.287135 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.287309 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.287479 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.287657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.287896 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.288067 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.288228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.288409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.288560 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.289857 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.290092 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.290254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.290525 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.290624 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.290863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.291169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.291283 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.291400 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.291515 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.291750 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.291999 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.292110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.292417 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.292510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.292747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.292887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.293120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.293281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.293477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.293608 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.293819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.293954 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.294184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.294289 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.294504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.294641 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.294819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.295043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.295188 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.295440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.295582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.295769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.295942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.296223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.296375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.296546 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.296688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.296859 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.297021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.297209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.297371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.297512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.297651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.297821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.297954 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.298180 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.298331 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.298474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.298607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.298746 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.298885 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.299025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.299156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.299344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.299479 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.299656 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.299787 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.299965 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.300108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.300298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.300440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.300597 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.300737 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.300954 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.301115 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.301307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.301452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.301615 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.301749 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.301919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.302099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.302232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.302362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.302521 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.302675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.302856 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.303000 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.303195 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.303337 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.303515 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.303743 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.303886 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.304085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.304219 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.304436 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.304574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.304791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.304925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.305153 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.305301 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.305469 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.305612 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.305782 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.305917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.306094 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.306228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.306430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.306631 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.306767 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.306897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.307053 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.307187 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.307368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.307512 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.307685 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.307822 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.308001 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.308143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.308316 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.308460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.308632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.308766 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.308946 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.309112 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.309291 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.309427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.309606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.309750 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.309921 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.310057 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.310237 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.310380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.310552 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.310694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.310866 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.311001 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.311183 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.311326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.311531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.311665 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.311859 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.312006 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.312190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.312331 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.312488 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.312630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.312800 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.312941 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.313149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.313289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.313452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.313585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.313767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.313912 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.314085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.314216 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.314404 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.314523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.314734 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.314862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.315064 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.315379 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.315706 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.315871 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.316031 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.316186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.316565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.316731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.316887 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.317058 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.317225 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.317393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.317548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.317701 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.317847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.318012 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.318165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.318321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.318467 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.318619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:24:35.318772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.318927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.319264 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.319585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.319927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.320358 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.320694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.321444 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.321444 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.321766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.321962 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.322278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.322606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.322923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.323233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.323544 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.323860 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.324172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.324485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.324795 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.325135 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.325454 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.325763 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.326071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.326385 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.326761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.326994 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.327300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.327615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.327924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.328234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.328639 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.328849 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.329212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.329564 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.329923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.330233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.330564 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.330887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.331214 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.331739 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.331929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.332163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.332491 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.332810 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.333184 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.333502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.333820 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.334135 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.334451 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.334766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.335080 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.335422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.336286 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.336673 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.337058 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.337366 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.337701 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.338025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.338384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.338780 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.339038 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.339356 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.339672 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.339989 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.340311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.340636 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.340953 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.341303 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.341767 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.341951 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.342270 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.342605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.342923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.343275 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.343583 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.343948 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.344269 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.344623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.345038 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.345328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.345652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.345962 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:24:35.346215 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:24:35.482742 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO dbcounter [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Registered counter for database nova_api Aug 10 13:24:35.502091 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO dbcounter [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Registered counter for database nova_api Aug 10 13:24:35.504948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_db.sqlalchemy.engines [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:24:35.513769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writer thread running {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:24:35.524004 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_db.sqlalchemy.engines [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:24:35.531029 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writer thread running {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:24:35.574729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.context [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),372f88b7-cf72-43dd-a32b-705a4ede3130(cell1) {{(pid=118002) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 13:24:35.578749 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:35.579232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:35.580810 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:35.581571 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:35.582030 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:35.584018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:35.586675 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO dbcounter [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Registered counter for database nova_cell0 Aug 10 13:24:35.590873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO dbcounter [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Registered counter for database nova_cell1 Aug 10 13:24:35.597624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.context [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),372f88b7-cf72-43dd-a32b-705a4ede3130(cell1) {{(pid=118003) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 13:24:35.598276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_db.sqlalchemy.engines [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:24:35.599998 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_db.sqlalchemy.engines [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:24:35.604855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:35.605632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:35.607026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writer thread running {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:24:35.608263 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:35.608376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writer thread running {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:24:35.609430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:35.610134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:35.613438 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:35.616572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO dbcounter [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Registered counter for database nova_cell0 Aug 10 13:24:35.621568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO dbcounter [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Registered counter for database nova_cell1 Aug 10 13:24:35.630671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_db.sqlalchemy.engines [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:24:35.632405 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_db.sqlalchemy.engines [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:24:35.640970 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writer thread running {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:24:35.643162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writer thread running {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:24:35.756827 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO dbcounter [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Registered counter for database nova_cell0 Aug 10 13:24:35.765174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_db.sqlalchemy.engines [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:24:35.769731 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writer thread running {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:24:35.796859 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO dbcounter [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Registered counter for database nova_cell0 Aug 10 13:24:35.803480 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_db.sqlalchemy.engines [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:24:35.807943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writer thread running {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:24:36.095370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: WARNING keystonemiddleware.auth_token [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:24:36.103251 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: WARNING keystonemiddleware.auth_token [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:24:36.145449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: WARNING keystonemiddleware.auth_token [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:24:36.153530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: WARNING keystonemiddleware.auth_token [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:24:36.449312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: WARNING keystonemiddleware.auth_token [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:24:36.455251 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: WARNING keystonemiddleware.auth_token [None req-edd485c7-18bd-484f-b1a9-9795738fb58f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:24:36.461537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd333df9c0 pid: 118002 (default app) Aug 10 13:24:36.498692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: WARNING keystonemiddleware.auth_token [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:24:36.504694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: WARNING keystonemiddleware.auth_token [None req-c8120851-e9e2-4db1-8ad3-5439cc2bfaaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:24:36.510982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd333df9c0 pid: 118003 (default app) Aug 10 13:25:13.214835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:13.215667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:13.216810 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:13.218173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:14.605636 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f429ca6f-7d04-4207-ba06-cf9e0582951f tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Action: 'create', calling method: .version_select at 0x7ff6a9866dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1192065842"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:16.412852 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f429ca6f-7d04-4207-ba06-cf9e0582951f tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.207188 Aug 10 13:25:16.413598 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Aug 10 13:25:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3213 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 13:25:16.433975 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=3 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:16.435084 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=3 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:16.438280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=3 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:16.439209 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=3 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:16.981548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4ee5b3e1-7313-4435-9cfe-18ef1d91fee9 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a98d4940>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:17.458960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4ee5b3e1-7313-4435-9cfe-18ef1d91fee9 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b" status: 200 len: 345 microversion: 2.1 time: 1.031050 Aug 10 13:25:17.460622 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 1/2] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:25:16 2022] GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b => generated 345 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:18.475624 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1cf9999b-117f-4d02-9e43-99ca7e78ee3d tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96e0c10>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:18.598231 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1cf9999b-117f-4d02-9e43-99ca7e78ee3d tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b" status: 200 len: 346 microversion: 2.1 time: 0.127641 Aug 10 13:25:18.599384 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:25:18 2022] GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:18.631344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f6018dba-e4f3-4328-af5c-d6f8d88bea33 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Action: 'create', calling method: .version_select at 0x7ff6a9718d30>, body: {"snapshot": {"volume_id": "a261ea2c-b3eb-44ed-ab96-01b184875c1b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-451950084"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:19.588752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f6018dba-e4f3-4328-af5c-d6f8d88bea33 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.972320 Aug 10 13:25:19.589712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 2/4] 10.222.0.40 () {60 vars in 1162 bytes} [Wed Aug 10 13:25:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:19.600648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ee6249ad-55ab-4f41-a55f-1bf7c0f12c46 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96f43a0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:19.758394 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ee6249ad-55ab-4f41-a55f-1bf7c0f12c46 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 200 len: 286 microversion: 2.1 time: 0.160651 Aug 10 13:25:19.759512 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:25:19 2022] GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:19.770790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1662feaf-8d3b-416a-98d2-6ad19da5681c tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a9718dc0>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:19.871248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1662feaf-8d3b-416a-98d2-6ad19da5681c tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.104409 Aug 10 13:25:19.872066 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Aug 10 13:25:19 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:19.891856 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-725777c7-2012-4b83-857a-930ef008222f tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96f4af0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:19.936742 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-725777c7-2012-4b83-857a-930ef008222f tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 200 len: 286 microversion: 2.1 time: 0.054629 Aug 10 13:25:19.938545 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:25:19 2022] GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:20.951919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0e5d8b26-3adc-4644-9bc3-7588b35f8324 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96f3c10>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:21.025477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0e5d8b26-3adc-4644-9bc3-7588b35f8324 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 200 len: 286 microversion: 2.1 time: 0.077985 Aug 10 13:25:21.026671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:25:20 2022] GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:22.039353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a4f87de5-1b04-4710-a157-d86e673a4c4f tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96e0dc0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:22.081741 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a4f87de5-1b04-4710-a157-d86e673a4c4f tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 200 len: 286 microversion: 2.1 time: 0.047248 Aug 10 13:25:22.082576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:25:22 2022] GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:23.097165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4c7d5ec3-1940-4f2c-ae7e-299146bf9f60 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96f3820>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:23.176329 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4c7d5ec3-1940-4f2c-ae7e-299146bf9f60 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 200 len: 286 microversion: 2.1 time: 0.084702 Aug 10 13:25:23.177605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 5/10] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:25:23 2022] GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:24.190881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6ec61ab6-0ced-4401-ac09-1bd6c18d447a tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96f4b80>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:24.249573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6ec61ab6-0ced-4401-ac09-1bd6c18d447a tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 200 len: 287 microversion: 2.1 time: 0.063452 Aug 10 13:25:24.251881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:25:24 2022] GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:24.271414 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8a9799ec-f532-4144-88c0-c7537672c631 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96f3280>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:24.481841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8a9799ec-f532-4144-88c0-c7537672c631 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 202 len: 0 microversion: 2.1 time: 0.222501 Aug 10 13:25:24.482808 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Aug 10 13:25:24 2022] DELETE /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:25:24.491691 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9c9d2f57-6c69-4840-a7e1-dc414f76370d tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96f4430>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:24.550000 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9c9d2f57-6c69-4840-a7e1-dc414f76370d tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 200 len: 286 microversion: 2.1 time: 0.062296 Aug 10 13:25:24.550879 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:25:24 2022] GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:25.563704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-807f7fbd-8da8-4cd6-ac25-bc20d974019c tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96dca60>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:25.669248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-807f7fbd-8da8-4cd6-ac25-bc20d974019c tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] HTTP exception thrown: Snapshot cdd6c857-16db-45ff-aaa8-05e3879c4144 could not be found. Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-807f7fbd-8da8-4cd6-ac25-bc20d974019c tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Request method failure captured: Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 HTTP/1.1 Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87G5-N3Hqh4fKCyfiNsJ9jTf8uOfK91YM1jpUOG3VCEFnX-ePh50wOj0GuKSfPZ2WGLBKBTEzM30o6SZraNOHOvQ_YLb25ayeG2OecgfQ7_dczxZhpCE7uak9qyOBXZjtfWFA5j4y0BIheQPnpjMuxajROdb5HPTynpt3SfLcfNfUis Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: d63f4e449ad24501aab056be873063fb Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:25:25.678694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63f4e449ad24501aab056be873063fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63f4e449ad24501aab056be873063fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63f4e449ad24501aab056be873063fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63f4e449ad24501aab056be873063fb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: d63f4e449ad24501aab056be873063fb Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-VolumesSnapshotsTestJSON-2066688088-project Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: abdfc175c6714dd6929a165693c8c07e Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2066688088-project Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Snapshot cdd6c857-16db-45ff-aaa8-05e3879c4144 could not be found. Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'cdd6c857-16db-45ff-aaa8-05e3879c4144'} Aug 10 13:25:25.679790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cdd6c857-16db-45ff-aaa8-05e3879c4144 could not be found. (HTTP 404) (Request-ID: req-6edf8ba9-d924-4621-b58c-8ca8a43591ee) Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:25.680413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:25:25.681393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cdd6c857-16db-45ff-aaa8-05e3879c4144 could not be found. Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 13:25:25.682507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cdd6c857-16db-45ff-aaa8-05e3879c4144 could not be found. Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cdd6c857-16db-45ff-aaa8-05e3879c4144 could not be found. Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-807f7fbd-8da8-4cd6-ac25-bc20d974019c tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Returning 404 to user: Snapshot cdd6c857-16db-45ff-aaa8-05e3879c4144 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:25:25.683786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-807f7fbd-8da8-4cd6-ac25-bc20d974019c tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144" status: 404 len: 111 microversion: 2.1 time: 0.121281 Aug 10 13:25:25.684609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 7/14] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:25:25 2022] GET /compute/v2.1/os-snapshots/cdd6c857-16db-45ff-aaa8-05e3879c4144 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:25:25.701254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-598eef03-567e-4ba2-8a48-e8366ff806e1 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a97011f0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:25.958499 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-598eef03-567e-4ba2-8a48-e8366ff806e1 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b" status: 202 len: 0 microversion: 2.1 time: 0.269636 Aug 10 13:25:25.960084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:25:25 2022] DELETE /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:25:25.969876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3f4f3668-f299-4020-9ea6-3aece4ff2215 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96590d0>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:26.062771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3f4f3668-f299-4020-9ea6-3aece4ff2215 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b" status: 200 len: 345 microversion: 2.1 time: 0.098142 Aug 10 13:25:26.063697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:25:25 2022] GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:27.079386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-db5388e9-ae2f-4447-86dd-93fed83c87b3 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a96f4280>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:27.134740 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-db5388e9-ae2f-4447-86dd-93fed83c87b3 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] HTTP exception thrown: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-db5388e9-ae2f-4447-86dd-93fed83c87b3 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Request method failure captured: Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b HTTP/1.1 Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87G5-N3Hqh4fKCyfiNsJ9jTf8uOfK91YM1jpUOG3VCEFnX-ePh50wOj0GuKSfPZ2WGLBKBTEzM30o6SZraNOHOvQ_YLb25ayeG2OecgfQ7_dczxZhpCE7uak9qyOBXZjtfWFA5j4y0BIheQPnpjMuxajROdb5HPTynpt3SfLcfNfUis Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: d63f4e449ad24501aab056be873063fb Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:25:27.140466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63f4e449ad24501aab056be873063fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63f4e449ad24501aab056be873063fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63f4e449ad24501aab056be873063fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63f4e449ad24501aab056be873063fb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: d63f4e449ad24501aab056be873063fb Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-VolumesSnapshotsTestJSON-2066688088-project Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: abdfc175c6714dd6929a165693c8c07e Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2066688088-project Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'a261ea2c-b3eb-44ed-ab96-01b184875c1b'} Aug 10 13:25:27.141599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. (HTTP 404) (Request-ID: req-b12fbae9-edd1-4d00-ab04-43c250dbecbd) Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.142396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:25:27.143269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:25:27.144203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.145105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.151354 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-db5388e9-ae2f-4447-86dd-93fed83c87b3 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Returning 404 to user: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:25:27.153945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-db5388e9-ae2f-4447-86dd-93fed83c87b3 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b" status: 404 len: 109 microversion: 2.1 time: 0.078689 Aug 10 13:25:27.153945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 9/17] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:25:27 2022] GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:25:27.172181 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a226e247-67b1-4391-b5a7-79f272114349 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6a9659820>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:27.224715 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-a226e247-67b1-4391-b5a7-79f272114349 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] HTTP exception thrown: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a226e247-67b1-4391-b5a7-79f272114349 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Request method failure captured: Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: DELETE /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b HTTP/1.1 Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87G5-N3Hqh4fKCyfiNsJ9jTf8uOfK91YM1jpUOG3VCEFnX-ePh50wOj0GuKSfPZ2WGLBKBTEzM30o6SZraNOHOvQ_YLb25ayeG2OecgfQ7_dczxZhpCE7uak9qyOBXZjtfWFA5j4y0BIheQPnpjMuxajROdb5HPTynpt3SfLcfNfUis Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: d63f4e449ad24501aab056be873063fb Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:25:27.227929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63f4e449ad24501aab056be873063fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63f4e449ad24501aab056be873063fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63f4e449ad24501aab056be873063fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63f4e449ad24501aab056be873063fb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: d63f4e449ad24501aab056be873063fb Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-VolumesSnapshotsTestJSON-2066688088-project Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: abdfc175c6714dd6929a165693c8c07e Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2066688088-project Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'a261ea2c-b3eb-44ed-ab96-01b184875c1b'} Aug 10 13:25:27.229657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. (HTTP 404) (Request-ID: req-04cb71df-2392-487a-8a5f-05db0338947e) Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.230415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:25:27.231497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 13:25:27.232748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a226e247-67b1-4391-b5a7-79f272114349 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Returning 404 to user: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:25:27.234207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a226e247-67b1-4391-b5a7-79f272114349 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b" status: 404 len: 109 microversion: 2.1 time: 0.067977 Aug 10 13:25:27.235873 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 9/18] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:25:27 2022] DELETE /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:25:27.244869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a3edd09c-0525-4435-b419-06d3c03d8a49 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Calling method '.version_select at 0x7ff6aa066280>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-a3edd09c-0525-4435-b419-06d3c03d8a49 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] HTTP exception thrown: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a3edd09c-0525-4435-b419-06d3c03d8a49 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Request method failure captured: Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b HTTP/1.1 Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87G5-N3Hqh4fKCyfiNsJ9jTf8uOfK91YM1jpUOG3VCEFnX-ePh50wOj0GuKSfPZ2WGLBKBTEzM30o6SZraNOHOvQ_YLb25ayeG2OecgfQ7_dczxZhpCE7uak9qyOBXZjtfWFA5j4y0BIheQPnpjMuxajROdb5HPTynpt3SfLcfNfUis Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: d63f4e449ad24501aab056be873063fb Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:25:27.360672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63f4e449ad24501aab056be873063fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63f4e449ad24501aab056be873063fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63f4e449ad24501aab056be873063fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63f4e449ad24501aab056be873063fb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: d63f4e449ad24501aab056be873063fb Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2066688088 Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-VolumesSnapshotsTestJSON-2066688088-project Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: abdfc175c6714dd6929a165693c8c07e Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2066688088-project Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'a261ea2c-b3eb-44ed-ab96-01b184875c1b'} Aug 10 13:25:27.365570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. (HTTP 404) (Request-ID: req-fe5dae9c-03bc-42cb-8c87-36f3f4519f18) Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.366234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:25:27.368026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:25:27.369431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a3edd09c-0525-4435-b419-06d3c03d8a49 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] Returning 404 to user: Volume a261ea2c-b3eb-44ed-ab96-01b184875c1b could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a3edd09c-0525-4435-b419-06d3c03d8a49 tempest-VolumesSnapshotsTestJSON-2066688088 tempest-VolumesSnapshotsTestJSON-2066688088-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b" status: 404 len: 109 microversion: 2.1 time: 0.057477 Aug 10 13:25:27.370658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 10/19] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:25:27 2022] GET /compute/v2.1/os-volumes/a261ea2c-b3eb-44ed-ab96-01b184875c1b => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:25:28.980147 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7fa88f06-6c96-4f27-9fcf-00fba81a2907 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'create', calling method: .version_select at 0x7ff6a9659b80>, body: {"keypair": {"name": "tempest-keypair-498883142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMbTRWHrQ2A83QBF+WFD8vFvUlnC/39wyVdXsyRKymJM1IXqGijhste8mN/jWCEBePYD3Jtr+qxQV1Gh1Ca3jclc2U6id+cTJnOoG93SjaPsgNOKXKjiaKa8G+PUVVA8w=="}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:29.113928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-7fa88f06-6c96-4f27-9fcf-00fba81a2907 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Getting quotas for project f3070abbdec34c779d4bd382b2bb1697. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:25:29.134022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-7fa88f06-6c96-4f27-9fcf-00fba81a2907 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Getting quotas for user 0ace2374550e40ce812407406c262ac5 and project f3070abbdec34c779d4bd382b2bb1697. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:25:29.336463 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7fa88f06-6c96-4f27-9fcf-00fba81a2907 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.485605 Aug 10 13:25:29.337416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 10/20] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:25:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:30.134095 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-935327814", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:30.393232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] validate_networks() for [('3cc4f7a8-eb4f-4476-bc15-27d7da2ccfc9', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:25:31.131704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d7c16a78-0828-4bf6-a07c-358d13766d5f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: .version_select at 0x7ff6a9618dc0>, body: {"keypair": {"name": "tempest-keypair-1865558630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7EbxziKFByIbkrOJzhIpaiqYb35tnZUGUmcGM0jk+DNGQnEftItnPgfBb3AGeVN8f07Cm4tB0IexX/xEShFuGJDTn7jqbOsMAbpm7IRKjt/D2rEScdAJVF7tQXlyX6WQ=="}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:31.181437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-d7c16a78-0828-4bf6-a07c-358d13766d5f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for project 26a97b47cc804e598c5e8680d279de19. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:25:31.181437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-d7c16a78-0828-4bf6-a07c-358d13766d5f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for user c9577bc4c4c546ca9fc220ebd3a16346 and project 26a97b47cc804e598c5e8680d279de19. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:25:31.293908 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d7c16a78-0828-4bf6-a07c-358d13766d5f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.572382 Aug 10 13:25:31.303162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 11/21] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:25:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:32.891452 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2086729104", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "networks": [{"uuid": "7b09c7e5-e1d2-45ff-8862-90e2a4a02606"}]}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:33.162464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.network.neutron [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] validate_networks() for [('7b09c7e5-e1d2-45ff-8862-90e2a4a02606', None, None, None, None, None)] {{(pid=118003) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:25:33.239049 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:25:33.239527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:25:33.240822 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:25:33.241310 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:25:33.242169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:25:33.280350 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:33.280849 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:33.286081 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:33.286921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:33.289762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:33.290213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:33.432072 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Getting quotas for project c0c9fae66a6f4ac9a0c1b0629e597906. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:25:33.455657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Getting quotas for user 4dfd3ee79da943b189824630b5c393ee and project c0c9fae66a6f4ac9a0c1b0629e597906. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:25:33.470257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:25:33.476907 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:25:33.753116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e2b3ff8d-d1bf-4604-a1e2-beba5fbaf3ad tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.387977 Aug 10 13:25:33.754346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 11/22] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:25:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 4390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:25:33.768048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0d32a249-7428-48ee-9c5d-97010dc5770f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:33.776065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0d32a249-7428-48ee-9c5d-97010dc5770f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:34.041990 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0d32a249-7428-48ee-9c5d-97010dc5770f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:34.073415 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0d32a249-7428-48ee-9c5d-97010dc5770f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1221 microversion: 2.1 time: 0.309411 Aug 10 13:25:34.089035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:33 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1221 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:34.461687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1157273694", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:34.587009 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] validate_networks() for [('3cc4f7a8-eb4f-4476-bc15-27d7da2ccfc9', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:25:35.943853 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:25:35.944691 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:25:35.946004 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:25:35.946563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:25:35.947144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:25:35.964525 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:35.966921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:35.967477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:35.968258 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:35.969312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:35.969777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:36.011169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Getting quotas for project c0c9fae66a6f4ac9a0c1b0629e597906. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:25:36.016560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Getting quotas for user 4dfd3ee79da943b189824630b5c393ee and project c0c9fae66a6f4ac9a0c1b0629e597906. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:25:36.039208 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:25:36.041663 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:25:36.225145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-59be98c4-fa58-49ba-b9b8-43fc308f8fe0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.768773 Aug 10 13:25:36.233647 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 13/24] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:25:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:25:36.239095 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-12173905", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f63fe725-8584-424d-903e-f50b1efc4f3a"}], "security_groups": [{"name": "tempest-securitygroup--1508294553"}], "key_name": "tempest-keypair-498883142", "user_data": "}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:36.259658 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Flavor limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:25:36.263510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Image limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:25:36.263510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Flavor pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:25:36.263510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Image pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:25:36.263510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:25:36.285815 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:36.288185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:36.292223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:36.292223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:36.292223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:36.292223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:36.378084 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Getting quotas for project e52ecd30866b4733acd28c43adbc29a0. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:25:36.394367 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Getting quotas for user a46db4eba75f4c49a394bffe4f220fe0 and project e52ecd30866b4733acd28c43adbc29a0. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:25:36.436805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Going to run 1 instances... {{(pid=118003) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:25:36.445824 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:25:36.542831 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] validate_networks() for [('f63fe725-8584-424d-903e-f50b1efc4f3a', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:25:36.641384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e9a89b11-e2b9-4c91-bb33-dd886682fa35 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.543327 Aug 10 13:25:36.643042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 12/25] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:25:36.650594 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a701b8b8-1613-4874-8763-206e426a6307 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:36.651979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a701b8b8-1613-4874-8763-206e426a6307 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:36.778911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a701b8b8-1613-4874-8763-206e426a6307 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:36.813272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a701b8b8-1613-4874-8763-206e426a6307 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1222 microversion: 2.1 time: 0.167261 Aug 10 13:25:36.829041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 13/26] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:36 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:36.829041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4556caa0-5c96-4092-a8fa-ee220b6493d8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:36.830772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-4556caa0-5c96-4092-a8fa-ee220b6493d8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:36.945834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-4556caa0-5c96-4092-a8fa-ee220b6493d8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:36.953781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4556caa0-5c96-4092-a8fa-ee220b6493d8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1215 microversion: 2.1 time: 0.135969 Aug 10 13:25:36.955616 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:36 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:36.963254 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1862008708", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0166bef-5b21-4630-8f39-894ba8f20530"}], "security_groups": [{"name": "tempest-securitygroup--944119890"}], "key_name": "tempest-keypair-1865558630", "user_data": "}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:37.222862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.network.neutron [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] validate_networks() for [('e0166bef-5b21-4630-8f39-894ba8f20530', None, None, None, None, None)] {{(pid=118003) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:25:37.540854 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:25:37.541667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:25:37.545563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:25:37.545563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:25:37.545563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:25:37.561378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:37.563404 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:37.565250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:37.568664 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:37.570978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:37.572617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:37.621155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Getting quotas for project f3070abbdec34c779d4bd382b2bb1697. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:25:37.630882 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Getting quotas for user 0ace2374550e40ce812407406c262ac5 and project f3070abbdec34c779d4bd382b2bb1697. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:25:37.645528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:25:37.648637 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:25:37.863889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-63b51506-f459-4536-8fce-b06da4df18f0 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.633387 Aug 10 13:25:37.864557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 14/28] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:25:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:25:37.889186 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7ca38d27-acd2-4c56-aa2e-309fc4755e8f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:37.891864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7ca38d27-acd2-4c56-aa2e-309fc4755e8f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:38.009997 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7ca38d27-acd2-4c56-aa2e-309fc4755e8f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:38.019738 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7ca38d27-acd2-4c56-aa2e-309fc4755e8f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1222 microversion: 2.1 time: 0.144503 Aug 10 13:25:38.034003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 15/29] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:37 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:38.042502 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9eee8a7a-e1a3-46c5-a233-b060888bde48 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:38.044297 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9eee8a7a-e1a3-46c5-a233-b060888bde48 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:38.117831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Flavor limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:25:38.117831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Image limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:25:38.117831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Flavor pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:25:38.117831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Image pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:25:38.117831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:25:38.133298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:38.133793 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:38.134236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:38.136982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:38.142548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:38.142548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:38.180016 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9eee8a7a-e1a3-46c5-a233-b060888bde48 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:38.189866 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9eee8a7a-e1a3-46c5-a233-b060888bde48 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1235 microversion: 2.1 time: 0.154710 Aug 10 13:25:38.193722 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 16/30] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:38 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1235 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:38.195794 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for project 26a97b47cc804e598c5e8680d279de19. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:25:38.214899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-741bb28f-0cd9-467b-a948-4ab9695ffdfb tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:38.215513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-741bb28f-0cd9-467b-a948-4ab9695ffdfb tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:38.224935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for user c9577bc4c4c546ca9fc220ebd3a16346 and project 26a97b47cc804e598c5e8680d279de19. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:25:38.263544 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Going to run 1 instances... {{(pid=118003) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:25:38.267304 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:25:38.370637 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-741bb28f-0cd9-467b-a948-4ab9695ffdfb tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:38.397961 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-741bb28f-0cd9-467b-a948-4ab9695ffdfb tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1215 microversion: 2.1 time: 0.197438 Aug 10 13:25:38.409144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 17/31] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:38 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:38.451512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1ff4f95d-fe87-4d50-84fb-8051c1d3246f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.494522 Aug 10 13:25:38.452220 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 15/32] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:25:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:25:38.463751 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-025fd519-6598-44a5-8560-592945d0c9a4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:38.464374 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-025fd519-6598-44a5-8560-592945d0c9a4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:38.792877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-025fd519-6598-44a5-8560-592945d0c9a4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:38.799625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-025fd519-6598-44a5-8560-592945d0c9a4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1242 microversion: 2.1 time: 0.339884 Aug 10 13:25:38.800210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 18/33] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:38 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1242 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:39.046670 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:39.047361 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:39.058546 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:39.062680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:39.062680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:39.062680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:39.063618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:39.064124 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:39.215320 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-50fc8c9b-d1f7-4e18-87f8-b52e2b0d5e9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:39.216005 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-50fc8c9b-d1f7-4e18-87f8-b52e2b0d5e9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:39.336286 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-50fc8c9b-d1f7-4e18-87f8-b52e2b0d5e9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:39.350586 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-50fc8c9b-d1f7-4e18-87f8-b52e2b0d5e9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1235 microversion: 2.1 time: 0.139796 Aug 10 13:25:39.366626 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 19/34] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:39 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1235 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:39.423999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:39.424855 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:39.434969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:39.438156 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:39.438758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:39.439430 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:39.439964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:39.446323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:39.528452 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:39.551059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-00618a8d-7bf1-49b5-b890-1d378b421dc8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1218 microversion: 2.1 time: 0.508887 Aug 10 13:25:39.557656 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 16/35] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:39 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1218 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:39.692777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:39.708215 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9541b4bf-5599-4efc-9181-dc97145eaa65 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1267 microversion: 2.1 time: 0.288163 Aug 10 13:25:39.708894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 20/36] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:39 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:39.823046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-aa5de577-0a05-4aed-9427-e8d887ae2c09 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:39.823738 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-aa5de577-0a05-4aed-9427-e8d887ae2c09 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:39.885880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-aa5de577-0a05-4aed-9427-e8d887ae2c09 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:39.894223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-aa5de577-0a05-4aed-9427-e8d887ae2c09 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1242 microversion: 2.1 time: 0.075641 Aug 10 13:25:39.895201 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 17/37] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:39 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:40.372509 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:40.373186 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:40.381755 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:40.384793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:40.386942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:40.389537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:40.390211 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:40.390826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:40.578967 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:40.580394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:40.598251 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:40.598772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:40.599236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:40.602199 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:40.604268 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:40.604729 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:40.617796 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:40.628867 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-649f14be-44c6-4dc4-8989-c9d356c867ae tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1231 microversion: 2.1 time: 0.260845 Aug 10 13:25:40.636257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 21/38] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:40 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1231 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:40.734415 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:40.735042 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:40.741703 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:40.742198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:40.742643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:40.743359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:40.743821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:40.744428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:40.905790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:40.916203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8b70e518-dccc-4933-a156-ca5a2b5ea633 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1282 microversion: 2.1 time: 0.342119 Aug 10 13:25:40.923700 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 18/39] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:40 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1282 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:40.949322 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:40.950104 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:40.967239 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:40.967857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:40.975585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:40.976406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:40.982922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:40.983041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:40.983134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:40.988129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6a1b7e75-2596-4531-a1bc-c4218a0dd4f5 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1275 microversion: 2.1 time: 0.256606 Aug 10 13:25:40.990609 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 22/40] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:40 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:41.265979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:41.283939 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e25cd6db-5b1e-48fb-b56b-40933a748607 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1238 microversion: 2.1 time: 0.349580 Aug 10 13:25:41.291227 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 19/41] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:40 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1238 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:41.654644 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:41.655270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:41.675064 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:41.675560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:41.675997 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:41.676704 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:41.677195 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:41.677627 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:41.827154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:41.836557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-94714186-97a5-45be-8453-486cb09a5f0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1295 microversion: 2.1 time: 0.185907 Aug 10 13:25:41.842927 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 23/42] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:41 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1295 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:41.951689 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:41.952263 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:41.984014 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:41.984911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:41.985485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:41.986299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:41.986934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:41.987502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:42.013798 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:42.014349 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:42.021706 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:42.022199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:42.023291 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:42.041434 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:42.043473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:42.043942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:42.161393 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:42.173313 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cb09a885-6c13-47c5-ab3f-78b227a11e99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1273 microversion: 2.1 time: 0.164079 Aug 10 13:25:42.192018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 24/43] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:42 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:42.206296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:42.227055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-532f5325-db46-4f11-893c-0082d7808f36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1280 microversion: 2.1 time: 0.285608 Aug 10 13:25:42.227913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 20/44] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:41 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:42.313774 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:42.314660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:42.328190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:42.328986 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:42.329574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:42.331108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:42.333579 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:42.334534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:42.531077 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:42.544313 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2b6abf3f-c40f-40e7-ac50-2c700d4da44f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1302 microversion: 2.1 time: 0.233289 Aug 10 13:25:42.560182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 25/45] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:42 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1302 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:42.874014 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:42.874789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:42.906219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:42.908357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:42.916614 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:42.921224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:42.923576 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:42.924443 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:43.202607 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:43.203871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:43.227174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:43.250465 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:43.252079 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:43.260861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:43.262667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:43.266221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:43.390840 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:43.402537 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-131236c8-61ef-4fbf-809f-eef2e4df42fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1293 microversion: 2.1 time: 0.538433 Aug 10 13:25:43.417107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 21/46] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:42 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1293 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:43.434968 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:43.445854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:43.471057 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:43.474401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:43.475861 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:43.479467 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:43.480192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:43.483282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:43.531689 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:43.551745 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e1de92c4-468e-4cb5-a816-6a6b2a396aaa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1273 microversion: 2.1 time: 0.353739 Aug 10 13:25:43.555287 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 26/47] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:43 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1273 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:43.585781 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:43.587242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:43.608442 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:43.609159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:43.609660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:43.610437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:43.610939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:43.611418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:44.138794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:44.153984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-efd26d03-efa6-4fe7-ab4b-23f7ce85d1f0 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1300 microversion: 2.1 time: 0.578754 Aug 10 13:25:44.158269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 27/48] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:43 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1300 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:44.443677 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:44.446007 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:44.456802 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:44.459528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:44.460181 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:44.462418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:44.465664 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:44.466527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:44.627466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:44.646477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-63dd7910-c125-4b61-8ef2-f7162d205e12 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1293 microversion: 2.1 time: 0.211193 Aug 10 13:25:44.668656 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 28/49] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:44 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1293 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:44.678070 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:44.679463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:44.689055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:44.689935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:44.690694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:44.691728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:44.694311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:44.696259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:44.853313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:44.877264 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-72aa1574-f1d2-48c8-83d7-80607f52933e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 1.456864 Aug 10 13:25:44.893213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 22/50] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:43 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:45.092131 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:45.105607 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6d0a5e01-6493-48f8-a20c-6476e567f6f8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.434708 Aug 10 13:25:45.107644 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 29/51] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:44 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:45.183834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:45.184656 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:45.193319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:45.193823 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:45.194260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:45.196701 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:45.197320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:45.197757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:45.674916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:45.680306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:45.684389 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:45.685260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:45.685958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:45.686917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:45.687894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:45.688623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:45.723233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:45.732284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7769ad6b-fc1a-40ed-80cb-974430b8466a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.553286 Aug 10 13:25:45.733205 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 23/52] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:45 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:45.905561 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:45.907252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:45.914874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:45.915462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:45.916161 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:45.916946 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:45.919618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:45.919790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:45.982199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:45.996795 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2dced709-8c0e-43a9-9a3b-1c1a7baf8fe5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1293 microversion: 2.1 time: 0.323140 Aug 10 13:25:45.997466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 30/53] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:45 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1293 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:46.129966 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:46.130924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:46.137794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:46.145414 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:46.145916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:46.146657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:46.147121 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:46.147556 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:46.293362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:46.305572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-555e989a-6f71-40a5-acea-c8370325ff36 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.405475 Aug 10 13:25:46.307160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 24/54] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:45 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:46.378458 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:46.389919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-071a371f-39e3-4408-ade8-75e189c6e26e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.265977 Aug 10 13:25:46.390526 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 31/55] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:46 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:46.687025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-ad4940eb-35e3-4713-a1d9-2143fd2d5361 req-a49a3e75-8fe8-42a4-a8ea-d44858b15e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654558bd-c765-4b55-96d4-c73b1fda4cb9", "tag": "66bba97d-ca44-4433-a3e8-773aa5032944"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:46.699578 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ad4940eb-35e3-4713-a1d9-2143fd2d5361 req-a49a3e75-8fe8-42a4-a8ea-d44858b15e56 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:46.700054 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ad4940eb-35e3-4713-a1d9-2143fd2d5361 req-a49a3e75-8fe8-42a4-a8ea-d44858b15e56 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:46.700480 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ad4940eb-35e3-4713-a1d9-2143fd2d5361 req-a49a3e75-8fe8-42a4-a8ea-d44858b15e56 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:46.719581 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-ad4940eb-35e3-4713-a1d9-2143fd2d5361 req-a49a3e75-8fe8-42a4-a8ea-d44858b15e56 service nova] Creating event network-changed:66bba97d-ca44-4433-a3e8-773aa5032944 for instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 on hv-cinder-83602 Aug 10 13:25:46.720098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ad4940eb-35e3-4713-a1d9-2143fd2d5361 req-a49a3e75-8fe8-42a4-a8ea-d44858b15e56 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118003) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 13:25:46.720495 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ad4940eb-35e3-4713-a1d9-2143fd2d5361 req-a49a3e75-8fe8-42a4-a8ea-d44858b15e56 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118003) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 13:25:46.721539 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:46.722002 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:46.722430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:46.723151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:46.723605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:46.724030 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:46.733028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.compute.rpcapi [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 13:25:46.733897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] Releasing lock "compute-rpcapi-router" {{(pid=118003) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 13:25:46.749045 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-62fd8a0b-b185-4300-a1cc-84b069924703 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116565 Aug 10 13:25:46.749655 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 25/56] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:46.754199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:46.754804 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:46.758572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:46.761900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:46.762380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:46.762821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:46.763760 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:46.764322 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:46.764415 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:46.896969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:46.904862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-19c380b1-cf48-4a4a-95c3-986189edb590 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.154569 Aug 10 13:25:46.905445 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 32/57] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:46 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:47.019219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:47.019942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:47.026948 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:47.027435 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:47.027873 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:47.028575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:47.029209 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:47.029641 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:47.163369 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:47.170856 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ff09e387-d1d0-4c40-b4d9-d0ed73a0798c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.155888 Aug 10 13:25:47.171416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 26/58] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:47 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:47.326631 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:47.327701 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:47.334532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:47.335221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:47.335815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:47.336695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:47.337463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:47.338061 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:47.418291 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:47.419290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:47.433320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:47.439917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:47.439917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:47.439917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:47.439917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:47.440399 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:47.563844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:47.575451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e5c72ff7-60e8-489b-aef3-ed70cd48a3aa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.252165 Aug 10 13:25:47.577503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 33/59] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:47 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:47.643598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:47.658434 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-708f59d1-0387-48b4-a623-ca6967a31c61 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.246894 Aug 10 13:25:47.659235 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 27/60] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:47 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:47.927974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:47.929878 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:47.933255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:47.939989 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:47.940691 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:47.941335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:47.942229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:47.943288 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:47.943897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:48.109398 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:48.120460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0256901f-0e09-4d63-8235-aec75a497d7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.197466 Aug 10 13:25:48.121348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 34/61] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:47 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:48.195027 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:48.195801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:48.202026 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:48.202508 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:48.202979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:48.203759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:48.204224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:48.204644 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:48.398389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:48.408191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d300ee79-7d45-463b-b90d-c3a2b2c7c941 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.218939 Aug 10 13:25:48.409103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 28/62] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:48 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:48.610828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:48.611454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:48.620376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:48.620871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:48.623475 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:48.624192 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:48.624656 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:48.625108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:48.679711 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:48.685906 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:48.686874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:48.723155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:48.723721 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:48.724479 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:48.726281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:48.727084 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:48.727983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:48.871608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:48.881127 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2ea9eb0a-6f9e-4e43-a46a-3782414f4d05 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.283679 Aug 10 13:25:48.883447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 35/63] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:48 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:48.931700 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:48.939451 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fc0386a4-3708-40bb-af52-7f8a34b6b552 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.258138 Aug 10 13:25:48.940579 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 29/64] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:48 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:49.143336 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:49.143980 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:49.154279 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:49.155650 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:49.170420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:49.171188 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:49.171663 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:49.172091 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:49.340791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=30 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:49.379881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:49.381928 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b2708dd1-d590-4dff-8ffa-64b1163b75a1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.243038 Aug 10 13:25:49.382506 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 36/65] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:49 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:49.433333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:49.434352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:49.448105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:49.449162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:49.449512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:49.450225 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:49.450882 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:49.451369 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:49.742175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:49.752550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3608e4ec-b727-4002-bbdc-752530804bfc tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.325730 Aug 10 13:25:49.753528 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 30/66] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:49 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:49.903749 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:49.904625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:49.914753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:49.915593 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:49.916225 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:49.917162 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:49.918420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:49.919205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:49.962759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:49.963294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:49.965308 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=26 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:49.970787 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:49.980051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:49.980892 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:49.981547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:49.982441 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:49.983085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:49.983697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:50.155498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:50.166927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-35a222bc-c2dd-424c-aa25-4ecc95ff6e91 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.209605 Aug 10 13:25:50.185837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 31/67] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:49 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:50.403248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:50.404359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:50.414506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:50.421535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:50.422457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:50.423500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:50.424167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:50.424804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:50.541351 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:50.565523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-341f58a7-62c0-49bd-b4d4-0da345197573 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.652481 Aug 10 13:25:50.570439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 37/68] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:49 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:50.775638 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:50.776652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:50.791607 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:50.793942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:50.794582 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:50.795485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:50.797023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:50.799270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:51.391175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:51.401387 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-89bc5afe-fa8d-4ada-909c-d5d061044dac tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 1.002402 Aug 10 13:25:51.413613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 32/69] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:50 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:51.423952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:51.424875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:51.432130 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:51.432919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:51.433731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:51.434690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:51.435338 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:51.435907 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:51.467220 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=100 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:51.514406 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:51.534284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-36552b2f-a7eb-4774-9b1b-4acd348cc234 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.763429 Aug 10 13:25:51.535862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 38/70] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:50 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:51.577939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:51.579895 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:51.587234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:51.598363 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:51.599029 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:51.599962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:51.600523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:51.602307 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:52.126917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:52.138921 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-94f80fad-5f6b-497b-a8d2-0d8bc6ef990a tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.723373 Aug 10 13:25:52.140042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 33/71] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:51 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:52.203046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:52.240018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-93cda0a9-b213-48d2-b267-0aa87ec27d9b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.664976 Aug 10 13:25:52.240018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 39/72] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:51 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:52.426754 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:52.427497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:52.453926 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:52.470481 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:52.477483 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:52.478333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:52.478911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:52.479439 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:52.556559 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:52.557334 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:52.575204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:52.577860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:52.579019 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:52.582967 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:52.584111 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:52.585923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:53.191202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:53.215811 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-031bb652-7403-4886-b8be-201e4ca8bd8a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.663690 Aug 10 13:25:53.216940 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 40/73] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:52 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:53.251344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:53.253048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:53.261334 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:53.261986 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:53.262565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:53.263450 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:53.264182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:53.264750 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:53.400496 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:53.413165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9870f767-d614-4ee6-bc53-5fbd8f83566d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.989913 Aug 10 13:25:53.469825 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 34/74] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:52 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:53.494051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:53.501492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:53.501492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:53.513832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:53.521781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:53.523588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:53.524222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:53.524819 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:54.223719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:54.236649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a7d0f30c-e220-4e26-8ee5-7db35a4f1c7d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 1.018410 Aug 10 13:25:54.240230 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 41/75] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:53 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:54.244484 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:54.255652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fddd93ac-b9b9-4fee-8865-2666e1f36743 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.778384 Aug 10 13:25:54.260257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 35/76] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:53 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:54.285440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:54.285440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:54.292394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:54.293225 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:54.293892 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:54.294791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:54.295456 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:54.296103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:54.572845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-51cf87d9-54b8-4bb9-a81c-4ad46dfa820d req-d917d52e-0d2a-43be-a549-9080c24a63a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f649e3d1-de4b-489a-9cd9-5812f58f3258", "tag": "eaf4a86a-3558-4360-a95c-6efcd16945c2"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:54.593812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-51cf87d9-54b8-4bb9-a81c-4ad46dfa820d req-d917d52e-0d2a-43be-a549-9080c24a63a0 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:54.594945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-51cf87d9-54b8-4bb9-a81c-4ad46dfa820d req-d917d52e-0d2a-43be-a549-9080c24a63a0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:54.595655 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-51cf87d9-54b8-4bb9-a81c-4ad46dfa820d req-d917d52e-0d2a-43be-a549-9080c24a63a0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:54.668388 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-51cf87d9-54b8-4bb9-a81c-4ad46dfa820d req-d917d52e-0d2a-43be-a549-9080c24a63a0 service nova] Creating event network-changed:eaf4a86a-3558-4360-a95c-6efcd16945c2 for instance f649e3d1-de4b-489a-9cd9-5812f58f3258 on hv-cinder-83602 Aug 10 13:25:54.669188 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-51cf87d9-54b8-4bb9-a81c-4ad46dfa820d req-d917d52e-0d2a-43be-a549-9080c24a63a0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 13:25:54.669614 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-51cf87d9-54b8-4bb9-a81c-4ad46dfa820d req-d917d52e-0d2a-43be-a549-9080c24a63a0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 13:25:54.673568 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:54.674874 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:54.675414 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:54.676108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:54.676569 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:54.677087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:54.703976 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.compute.rpcapi [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 13:25:54.705134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] Releasing lock "compute-rpcapi-router" {{(pid=118002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 13:25:54.724798 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-61d80e5b-5f0c-401a-b570-eb90835a804a None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.469982 Aug 10 13:25:54.726414 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 42/77] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:54.731839 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-e14b925a-15a4-4902-ba2b-ba9b6ed88f8c req-d6519bd2-e073-45b4-872b-4f8f269a0231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee", "tag": "032ceaa2-c6c2-4d87-a0e9-9002f6deab51"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:54.779306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e14b925a-15a4-4902-ba2b-ba9b6ed88f8c req-d6519bd2-e073-45b4-872b-4f8f269a0231 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:54.780629 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e14b925a-15a4-4902-ba2b-ba9b6ed88f8c req-d6519bd2-e073-45b4-872b-4f8f269a0231 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:54.788102 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e14b925a-15a4-4902-ba2b-ba9b6ed88f8c req-d6519bd2-e073-45b4-872b-4f8f269a0231 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:54.815719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:54.822909 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-e14b925a-15a4-4902-ba2b-ba9b6ed88f8c req-d6519bd2-e073-45b4-872b-4f8f269a0231 service nova] Creating event network-changed:032ceaa2-c6c2-4d87-a0e9-9002f6deab51 for instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee on hv-cinder-83602 Aug 10 13:25:54.824129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b641ea61-2de6-4f84-8757-50984a30d09d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.561660 Aug 10 13:25:54.826068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 36/78] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:54 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:54.831975 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:54.833230 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:54.840521 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-e14b925a-15a4-4902-ba2b-ba9b6ed88f8c req-d6519bd2-e073-45b4-872b-4f8f269a0231 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111973 Aug 10 13:25:54.843666 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 43/79] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:54.846773 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:54.847497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:54.848122 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:54.849051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:54.849695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:54.850325 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:55.153832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:55.175409 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2e3a63a2-5693-4a45-b39a-16431fd5d144 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.336746 Aug 10 13:25:55.179720 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 37/80] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:54 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:55.264526 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:55.265260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:55.277330 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:55.282343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:55.282343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:55.282343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:55.282972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:55.283140 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:55.283227 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:55.283369 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:55.300427 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:55.303605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:55.304262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:55.308918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:55.310519 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:55.314379 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:55.889182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:55.930492 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3921b118-4834-4c3a-b99a-e2ca7288516f tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.669990 Aug 10 13:25:55.931485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 44/81] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:55 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:55.971276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:55.972664 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:55.987543 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:55.989191 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:55.989847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:55.990752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:55.993925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:55.994709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:56.167085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:56.182311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8dd3b41a-14b6-429f-b558-a45cf9d7f4f3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.906146 Aug 10 13:25:56.182988 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 38/82] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:55 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:56.202874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:56.204783 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:56.227926 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:56.228777 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:56.229685 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:56.230582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:56.231337 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:56.231980 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:56.377854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:56.385875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2f469d8d-6ba3-4875-b3d6-16470998c930 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.191355 Aug 10 13:25:56.386465 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 39/83] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:56 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:56.534319 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:56.544075 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-17663595-fc9c-4c9a-a16d-e0fbc81dd536 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.610492 Aug 10 13:25:56.545421 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 45/84] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:55 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:56.780872 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-38c1c9b6-587c-4d7c-8078-eccc92ba0f9d req-df54645c-c534-4193-82e4-ff3243ddca4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632d02cd-2985-4976-944b-0a5c9acf06c6", "tag": "0c6cfffc-b3b5-4dd3-8de0-efb030b38e70"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:56.786134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=6 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:56.791381 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-38c1c9b6-587c-4d7c-8078-eccc92ba0f9d req-df54645c-c534-4193-82e4-ff3243ddca4a service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:56.791852 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-38c1c9b6-587c-4d7c-8078-eccc92ba0f9d req-df54645c-c534-4193-82e4-ff3243ddca4a service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:56.792273 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-38c1c9b6-587c-4d7c-8078-eccc92ba0f9d req-df54645c-c534-4193-82e4-ff3243ddca4a service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:56.803963 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-38c1c9b6-587c-4d7c-8078-eccc92ba0f9d req-df54645c-c534-4193-82e4-ff3243ddca4a service nova] Creating event network-changed:0c6cfffc-b3b5-4dd3-8de0-efb030b38e70 for instance 632d02cd-2985-4976-944b-0a5c9acf06c6 on hv-cinder-83602 Aug 10 13:25:56.809894 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-38c1c9b6-587c-4d7c-8078-eccc92ba0f9d req-df54645c-c534-4193-82e4-ff3243ddca4a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032983 Aug 10 13:25:56.810483 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 40/85] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:56.868050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-160d83e2-4f55-426f-8b47-ac61b45e7613 req-6b967542-06bf-4f57-bf1f-e99dc7e519b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280", "tag": "5bf722b9-3a94-4cb8-b29c-ff395567c59a"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:25:56.877305 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-160d83e2-4f55-426f-8b47-ac61b45e7613 req-6b967542-06bf-4f57-bf1f-e99dc7e519b8 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:56.877782 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-160d83e2-4f55-426f-8b47-ac61b45e7613 req-6b967542-06bf-4f57-bf1f-e99dc7e519b8 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:56.878207 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-160d83e2-4f55-426f-8b47-ac61b45e7613 req-6b967542-06bf-4f57-bf1f-e99dc7e519b8 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:56.900261 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-160d83e2-4f55-426f-8b47-ac61b45e7613 req-6b967542-06bf-4f57-bf1f-e99dc7e519b8 service nova] Creating event network-changed:5bf722b9-3a94-4cb8-b29c-ff395567c59a for instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 on hv-cinder-83602 Aug 10 13:25:56.909025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-160d83e2-4f55-426f-8b47-ac61b45e7613 req-6b967542-06bf-4f57-bf1f-e99dc7e519b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044801 Aug 10 13:25:56.909769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 46/86] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:25:56.953770 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:56.954462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:56.961181 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:56.967202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:56.967202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:56.967202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:56.967202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:56.967513 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:57.137965 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:57.145521 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0b2c2df7-2f3c-480f-97c6-6c3ad543bdd3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.196128 Aug 10 13:25:57.146089 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 41/87] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:56 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:57.207515 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:57.208403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:57.215836 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:57.216522 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:57.217437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:57.218384 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:57.219025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:57.219644 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:57.407049 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:57.408260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:57.416788 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:57.419507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:57.422221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:57.423004 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:57.427010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:57.427607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:57.428194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:57.428720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-10a36ccc-9173-4fb6-a57c-2ccaf3888cf5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.224739 Aug 10 13:25:57.435099 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 47/88] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:57 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:57.570987 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:57.572260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:57.583005 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:57.583657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:57.585493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:57.586431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:57.589979 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:57.591007 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:57.673753 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:57.685592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e5350ec8-3a27-4bec-87de-4fc171c88730 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.282703 Aug 10 13:25:57.700847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 42/89] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:57 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:57.804164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:57.811978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dbfdc98f-dfd2-4b0e-8072-aa551c69f2c5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.246576 Aug 10 13:25:57.813031 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 48/90] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:57 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:25:58.167061 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:58.167673 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:58.173588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:58.174071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:58.174526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:58.175222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:58.175761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:58.176398 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:58.335251 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:58.343679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f4a3ae6e-4c40-4a38-b5c9-72ecc469053d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.180729 Aug 10 13:25:58.344444 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 43/91] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:58 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:58.448779 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:58.450886 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:58.456062 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:58.456545 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:58.456979 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:58.457778 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:58.458230 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:58.458655 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:58.600157 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:58.609900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7842444e-aaec-46c6-9ff4-dec4817c47b6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.164945 Aug 10 13:25:58.610796 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 49/92] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:58 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:58.710855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:58.712557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:58.718491 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:58.718968 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:58.719406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:58.720107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:58.720639 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:58.720974 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:58.837766 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:58.838783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:58.848207 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:58.861110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:58.863232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:58.863905 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:58.864246 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:58.871059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:58.874370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:58.874492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8239fad6-56e9-464b-bebc-773c134cd637 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.165583 Aug 10 13:25:58.885756 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 44/93] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:58 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:59.054123 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:59.063585 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5976af4a-240b-46d9-bb78-c81b4dd6610d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.233046 Aug 10 13:25:59.063953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 50/94] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:58 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:59.367653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:59.368545 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:59.377936 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:59.378670 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:59.379410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:59.380476 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:59.381368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:59.381911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:59.558886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:59.569765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fd80935a-44a4-4ace-b9a5-8faff7aa7a55 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.205773 Aug 10 13:25:59.570372 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 45/95] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:59 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:59.633721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:59.636703 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:59.643673 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:59.644190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:59.644630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:59.662043 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:59.665948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:59.665948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:59.892385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:25:59.895613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:25:59.896865 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:25:59.901077 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-47438033-ebb4-48b7-b085-c277c196de34 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.273600 Aug 10 13:25:59.901654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 51/96] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:59 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:25:59.903959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:59.904696 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:59.905066 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:25:59.905950 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:25:59.906412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:25:59.906838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:00.054286 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:00.065447 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a579595f-3a55-4ae8-bced-6c8217145997 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.174221 Aug 10 13:26:00.081106 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 46/97] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:25:59 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:00.085359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:00.086282 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:00.094594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:00.095790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:00.096475 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:00.097877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:00.098651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:00.099348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:00.259707 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:00.267145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7bbeb437-c0c9-442c-a79b-ac641c4ce757 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.186508 Aug 10 13:26:00.268143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 52/98] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:00 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:00.597504 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:00.598432 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:00.610002 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:00.612224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:00.614534 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:00.615438 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:00.619207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:00.619744 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:00.840093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:00.853733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-84afb69c-54fb-4039-be30-4e0cb71d90d6 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.260309 Aug 10 13:26:00.854878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 47/99] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:00 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:00.922400 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:00.923147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:00.929425 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:00.929916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:00.931052 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:00.931753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:00.932230 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:00.932832 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:01.082577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:01.094106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:01.094272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:01.094272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:01.094802 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c8b6af6a-1e41-44ca-bbeb-1200e33c7330 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.175661 Aug 10 13:26:01.097692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:01.098426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:01.099013 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:01.099871 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:01.101272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:01.101867 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:01.106677 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 53/100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:00 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:01.240880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:01.248851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f452f0c0-ba0b-4970-b034-4c8f06f18d6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.164825 Aug 10 13:26:01.251418 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 48/101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:01 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:01.293761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:01.294527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:01.306785 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:01.308917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:01.308917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:01.308917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:01.309604 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:01.310244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:01.528801 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:01.537471 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b12b8188-46e4-48cd-a9df-6d8fb3bcac57 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.253085 Aug 10 13:26:01.538268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 54/102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:01 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:01.874947 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:01.875570 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:01.882140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:01.882639 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:01.883067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:01.884805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:01.885509 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:01.885941 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:02.153460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:02.153460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:02.153460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:02.153460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:02.154470 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:02.154470 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:02.154470 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:02.154470 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:02.218844 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:02.230375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1fb61c9a-e94b-4112-8afc-fb484a40307b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.359248 Aug 10 13:26:02.230972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 49/103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:01 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:02.271263 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:02.272050 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:02.279092 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:02.279679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:02.280173 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:02.281048 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:02.281642 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:02.282249 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:02.310393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=100 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:02.376837 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:02.386234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-866f71bd-0ebe-4946-8b3c-26e021134f55 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.272286 Aug 10 13:26:02.399754 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 55/104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:02 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:02.559694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:02.560213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:02.566054 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:02.566544 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:02.566979 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:02.567663 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:02.568115 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:02.568539 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:02.660690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:02.675131 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7dd269fc-250c-4f84-880d-dff116426753 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.408550 Aug 10 13:26:02.676067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 50/105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:02 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:02.768099 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:02.778201 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-551fc7b7-4f30-46aa-afe4-189e3450964e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.223036 Aug 10 13:26:02.779437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 56/106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:02 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:03.240905 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-4a7ea32f-3520-4e9f-bf1f-cc4fc5b479c5 req-c7c63b8a-c7dc-4332-8ee9-a5f5e9eca06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f649e3d1-de4b-489a-9cd9-5812f58f3258", "name": "network-vif-plugged", "status": "completed", "tag": "eaf4a86a-3558-4360-a95c-6efcd16945c2"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:03.254751 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:03.255899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:03.256750 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4a7ea32f-3520-4e9f-bf1f-cc4fc5b479c5 req-c7c63b8a-c7dc-4332-8ee9-a5f5e9eca06c service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.257671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4a7ea32f-3520-4e9f-bf1f-cc4fc5b479c5 req-c7c63b8a-c7dc-4332-8ee9-a5f5e9eca06c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.258469 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4a7ea32f-3520-4e9f-bf1f-cc4fc5b479c5 req-c7c63b8a-c7dc-4332-8ee9-a5f5e9eca06c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.262676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.263163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.263752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.264660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.266046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.266630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.275755 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-4a7ea32f-3520-4e9f-bf1f-cc4fc5b479c5 req-c7c63b8a-c7dc-4332-8ee9-a5f5e9eca06c service nova] Creating event network-vif-plugged:eaf4a86a-3558-4360-a95c-6efcd16945c2 for instance f649e3d1-de4b-489a-9cd9-5812f58f3258 on hv-cinder-83602 Aug 10 13:26:03.282227 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-4a7ea32f-3520-4e9f-bf1f-cc4fc5b479c5 req-c7c63b8a-c7dc-4332-8ee9-a5f5e9eca06c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111006 Aug 10 13:26:03.283954 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 51/107] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:03.411909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:03.412625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:03.420765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.421298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.421727 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.422708 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.423690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.424247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.510494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:03.525236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0941daa1-feff-4732-9ad7-768177b23d5e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.274110 Aug 10 13:26:03.526488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 57/108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:03 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:03.606420 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:03.614452 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c3c04261-7f81-4ccb-bdf5-513a52f2b9b3 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.209956 Aug 10 13:26:03.615520 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 52/109] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:03 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:03.699145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:03.699145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:03.704262 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.705078 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.705191 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.705880 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.706343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.706734 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.800414 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:03.801434 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:03.811778 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.813838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.814482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.815238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:03.815699 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:03.820298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:03.924407 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:03.933827 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d753cad5-d0e0-415e-8f15-ffaa13963945 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.240970 Aug 10 13:26:03.947594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 58/110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:03 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:04.103250 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:04.116844 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-99200670-6885-4bcf-bf32-a726b241dee4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.318704 Aug 10 13:26:04.123972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 53/111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:03 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:04.547013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:04.547738 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:04.554882 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:04.556171 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:04.556875 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:04.562341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:04.562341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:04.562341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:04.636206 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:04.636815 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:04.650785 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:04.651439 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:04.651983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:04.653435 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:04.657403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:04.658419 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:04.699125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:04.740292 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:04.749332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c369b4fc-541f-438d-92c8-7884d8d4016e tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.206492 Aug 10 13:26:04.761025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 59/112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:04 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:04.818871 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:04.827744 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c3b70859-b735-4b25-b358-a9b1fa3fe8ce tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.196095 Aug 10 13:26:04.828426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 54/113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:04 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:04.954654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:04.955652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:04.962518 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:04.963476 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:04.963959 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:04.964669 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:04.965176 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:04.965753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:05.112114 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:05.129733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2c531ddb-b351-4d2c-9d59-863c0c607a26 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.172349 Aug 10 13:26:05.129733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 60/114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:04 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:05.151232 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:05.151851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:05.158818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:05.159415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:05.159919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:05.160696 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:05.161264 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:05.161787 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:05.293860 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:05.301979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f5e6b884-e130-442a-a127-56d0a02b2635 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.156438 Aug 10 13:26:05.313360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 55/115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:05 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:05.773102 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:05.773102 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:05.780370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:05.780865 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:05.781559 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:05.782270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:05.783086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:05.783561 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:05.849255 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:05.853892 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:05.856184 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:05.856927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:05.857453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:05.858247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:05.858881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:05.859497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:05.947254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:05.958645 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-27236e6b-a1b2-4ebc-b199-96fd7ce81673 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.192115 Aug 10 13:26:05.959483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 61/116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:05 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:05.964735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-c12b3749-f970-4959-94a0-8647721ba9d5 req-e4ddac0f-6c54-4bef-a9d7-f226784545d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632d02cd-2985-4976-944b-0a5c9acf06c6", "name": "network-vif-plugged", "status": "completed", "tag": "0c6cfffc-b3b5-4dd3-8de0-efb030b38e70"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:05.983442 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-c12b3749-f970-4959-94a0-8647721ba9d5 req-e4ddac0f-6c54-4bef-a9d7-f226784545d5 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:05.983442 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-c12b3749-f970-4959-94a0-8647721ba9d5 req-e4ddac0f-6c54-4bef-a9d7-f226784545d5 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:05.983442 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-c12b3749-f970-4959-94a0-8647721ba9d5 req-e4ddac0f-6c54-4bef-a9d7-f226784545d5 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:05.995299 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-c12b3749-f970-4959-94a0-8647721ba9d5 req-e4ddac0f-6c54-4bef-a9d7-f226784545d5 service nova] Creating event network-vif-plugged:0c6cfffc-b3b5-4dd3-8de0-efb030b38e70 for instance 632d02cd-2985-4976-944b-0a5c9acf06c6 on hv-cinder-83602 Aug 10 13:26:06.002755 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-c12b3749-f970-4959-94a0-8647721ba9d5 req-e4ddac0f-6c54-4bef-a9d7-f226784545d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041945 Aug 10 13:26:06.004145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 62/117] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:06.022994 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:06.044352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3a1f4bb9-850a-453b-a9fc-a60b34ac22f1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.198684 Aug 10 13:26:06.057949 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 56/118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:05 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:06.147262 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:06.147957 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:06.155281 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:06.155756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:06.156178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:06.156860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:06.157336 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:06.157748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:06.323767 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:06.324619 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:06.330746 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:06.331348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:06.331846 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:06.333847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:06.334280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:06.334280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:06.334280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:06.341270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2b522292-9545-47e5-a4d7-f7ba58a36a90 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.198303 Aug 10 13:26:06.341842 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 63/119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:06 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:06.497780 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:06.506951 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-77b87290-0898-4439-860f-645b50fefd78 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.187734 Aug 10 13:26:06.507595 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 57/120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:06 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:06.981220 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:06.982366 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:06.988714 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:06.989358 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:06.989974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:06.990775 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:06.991272 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:06.992019 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:07.071266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:07.073299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:07.080299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:07.081030 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:07.081636 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:07.082830 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:07.083430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:07.083996 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:07.181987 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:07.191866 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6f752442-ca13-4de4-8f67-3e21c8e69d40 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.215043 Aug 10 13:26:07.209465 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 64/121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:06 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:07.273103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:07.286513 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e15b0799-07ad-43b0-b852-e3702c1fc818 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.214661 Aug 10 13:26:07.286513 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 58/122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:07 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:07.363103 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:07.364271 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:07.373688 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:07.374807 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:07.375344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:07.376126 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:07.376672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:07.377297 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:07.531501 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:07.532673 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:07.534785 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:07.542694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0aa71dcd-d5c2-4fd7-bcda-b20c9367a5d6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1367 microversion: 2.1 time: 0.183509 Aug 10 13:26:07.544971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 65/123] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:07 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:07.547778 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:07.561129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:07.561129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:07.561129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:07.561129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:07.561462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:07.756073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:07.767041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8f96d860-f2c1-4546-9091-8912760ebef4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.239924 Aug 10 13:26:07.767833 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 59/124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:07 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:08.036770 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-1e8099fd-eb06-4026-98ad-75c5feba69ba req-93e5d31d-b057-4193-89b9-01a0472b8ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654558bd-c765-4b55-96d4-c73b1fda4cb9", "name": "network-vif-plugged", "status": "completed", "tag": "66bba97d-ca44-4433-a3e8-773aa5032944"}, {"server_uuid": "ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee", "name": "network-vif-plugged", "status": "completed", "tag": "032ceaa2-c6c2-4d87-a0e9-9002f6deab51"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:08.049476 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1e8099fd-eb06-4026-98ad-75c5feba69ba req-93e5d31d-b057-4193-89b9-01a0472b8ac1 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.050138 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1e8099fd-eb06-4026-98ad-75c5feba69ba req-93e5d31d-b057-4193-89b9-01a0472b8ac1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.050591 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1e8099fd-eb06-4026-98ad-75c5feba69ba req-93e5d31d-b057-4193-89b9-01a0472b8ac1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.064356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-1e8099fd-eb06-4026-98ad-75c5feba69ba req-93e5d31d-b057-4193-89b9-01a0472b8ac1 service nova] Creating event network-vif-plugged:66bba97d-ca44-4433-a3e8-773aa5032944 for instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 on hv-cinder-83602 Aug 10 13:26:08.067250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-1e8099fd-eb06-4026-98ad-75c5feba69ba req-93e5d31d-b057-4193-89b9-01a0472b8ac1 service nova] Creating event network-vif-plugged:032ceaa2-c6c2-4d87-a0e9-9002f6deab51 for instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee on hv-cinder-83602 Aug 10 13:26:08.072216 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-1e8099fd-eb06-4026-98ad-75c5feba69ba req-93e5d31d-b057-4193-89b9-01a0472b8ac1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039616 Aug 10 13:26:08.072969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 66/125] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:08.230219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:08.230851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:08.237830 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.238321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.238758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.239464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.239914 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.240703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.306594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:08.307597 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:08.318786 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.322395 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.323784 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.324687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.327523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.328156 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.467341 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:08.478674 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c8ea7895-f7b0-4dc6-ab95-0766e02ea39b tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.257965 Aug 10 13:26:08.480951 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 60/126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:08 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:08.558371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:08.576146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-40a3441a-5f6d-4a8a-8aa3-e90cc1a4aa87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.274684 Aug 10 13:26:08.576726 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 67/127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:08 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:08.581355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:08.582056 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:08.593752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.596044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.596646 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.597739 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.598525 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.604969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.793221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:08.793221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:08.799650 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.800555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.802883 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.805597 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:08.806520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:08.807122 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:08.955214 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:08.967609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5e576369-447c-4428-a079-ba46355e1b66 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1557 microversion: 2.1 time: 0.398832 Aug 10 13:26:08.981092 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 61/128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:08 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1557 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:08.987785 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:08.997694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b3db635f-9eb6-4c66-a9d7-92956bfc918f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.212771 Aug 10 13:26:08.997925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:08.998427 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:08.998970 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 68/129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:08 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:09.008293 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:09.009405 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:09.018771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:09.018771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:09.018771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:09.018771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:09.164740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0f871b3e-6b20-48b6-9081-8e7b893fbbc9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170715 Aug 10 13:26:09.164740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 62/130] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 10 13:26:08 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:26:09.501846 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:09.502528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:09.512080 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:09.518728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:09.520288 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:09.522963 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:09.524306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:09.525475 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:09.600215 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:09.600834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:09.607772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:09.608272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:09.608715 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:09.609736 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:09.610379 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:09.610802 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:09.828584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:09.841640 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0e6d39f3-0adb-4cf2-8c56-870c5fb72963 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1322 microversion: 2.1 time: 0.244255 Aug 10 13:26:09.844472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 63/131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:09 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:10.002681 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:10.019190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:10.022025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:10.028694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:10.029359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:10.029799 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:10.031390 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:10.032182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-bf234667-4d96-48b0-b7a5-de795ee6adc8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1315 microversion: 2.1 time: 0.533827 Aug 10 13:26:10.032593 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:10.033458 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:10.035097 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 69/132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:09 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:10.089826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-f8a717cb-bcd7-46b2-8591-2293f4e00111 req-829592e7-85d4-4caa-8c4b-5129b8f76986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280", "name": "network-vif-plugged", "status": "completed", "tag": "5bf722b9-3a94-4cb8-b29c-ff395567c59a"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:10.100274 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-f8a717cb-bcd7-46b2-8591-2293f4e00111 req-829592e7-85d4-4caa-8c4b-5129b8f76986 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:10.101100 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-f8a717cb-bcd7-46b2-8591-2293f4e00111 req-829592e7-85d4-4caa-8c4b-5129b8f76986 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:10.101906 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-f8a717cb-bcd7-46b2-8591-2293f4e00111 req-829592e7-85d4-4caa-8c4b-5129b8f76986 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:10.127210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-f8a717cb-bcd7-46b2-8591-2293f4e00111 req-829592e7-85d4-4caa-8c4b-5129b8f76986 service nova] Creating event network-vif-plugged:5bf722b9-3a94-4cb8-b29c-ff395567c59a for instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 on hv-cinder-83602 Aug 10 13:26:10.142187 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-f8a717cb-bcd7-46b2-8591-2293f4e00111 req-829592e7-85d4-4caa-8c4b-5129b8f76986 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052306 Aug 10 13:26:10.143120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 70/133] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:26:10.214412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:10.221984 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f7f5d918-c279-40be-a2d2-9fbe93dec305 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.206775 Aug 10 13:26:10.222565 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 64/134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:10 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:10.903344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-ba83db8b-ebb6-4cf6-b4e9-247d447fef0f req-15d50882-9fb9-452b-84ee-c764e28e2544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632d02cd-2985-4976-944b-0a5c9acf06c6", "tag": "0c6cfffc-b3b5-4dd3-8de0-efb030b38e70"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:10.904707 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:10.909311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:10.926834 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:10.926834 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:10.926834 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:10.927096 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ba83db8b-ebb6-4cf6-b4e9-247d447fef0f req-15d50882-9fb9-452b-84ee-c764e28e2544 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:10.927552 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:10.928121 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ba83db8b-ebb6-4cf6-b4e9-247d447fef0f req-15d50882-9fb9-452b-84ee-c764e28e2544 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:10.928835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:10.929430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ba83db8b-ebb6-4cf6-b4e9-247d447fef0f req-15d50882-9fb9-452b-84ee-c764e28e2544 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:10.930050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:10.957035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-ba83db8b-ebb6-4cf6-b4e9-247d447fef0f req-15d50882-9fb9-452b-84ee-c764e28e2544 service nova] Creating event network-changed:0c6cfffc-b3b5-4dd3-8de0-efb030b38e70 for instance 632d02cd-2985-4976-944b-0a5c9acf06c6 on hv-cinder-83602 Aug 10 13:26:10.966502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-ba83db8b-ebb6-4cf6-b4e9-247d447fef0f req-15d50882-9fb9-452b-84ee-c764e28e2544 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068059 Aug 10 13:26:10.970688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 65/135] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:11.059244 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:11.060449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:11.069587 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:11.070061 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:11.071683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:11.073362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:11.074140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:11.074819 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:11.180719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:11.196881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a4a092af-acdc-419c-97c9-ba4b0b20f0b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1517 microversion: 2.1 time: 0.330445 Aug 10 13:26:11.205378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 71/136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:10 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1517 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:11.226962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:11.231096 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:11.238082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:11.239391 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:11.240198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:11.241340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:11.241909 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:11.242964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:11.326926 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:11.337988 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lazy-loading 'flavor' on Instance uuid 654558bd-c765-4b55-96d4-c73b1fda4cb9 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:26:11.647189 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9e67a17d-b769-4a29-b79b-c81260b54446 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9/action" status: 200 len: 32 microversion: 2.1 time: 0.431818 Aug 10 13:26:11.648312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 72/137] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:26:11 2022] POST /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:26:11.667929 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:11.668845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:11.682214 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:11.682941 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:11.683576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:11.685560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:11.685984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:11.686413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:11.809883 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:11.824253 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a0685e08-7675-4840-8702-4309eca99daa tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1503 microversion: 2.1 time: 0.769611 Aug 10 13:26:11.824890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 66/138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:11 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1503 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:11.841887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:11.845402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:11.863362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:11.863864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:11.866692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:11.870977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:11.870977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:11.870977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:11.992018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:12.004046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2a932051-ab0f-4792-8f25-4278475cc7b9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.354327 Aug 10 13:26:12.007255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 73/139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:11 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:12.090968 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:12.103092 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a885bfd6-1c44-416d-8440-66f173867768 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.275235 Aug 10 13:26:12.107784 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 67/140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:11 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:13.028432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:13.029357 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:13.040788 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:13.041333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:13.041775 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:13.042515 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:13.042973 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:13.043463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:13.129815 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:13.130436 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:13.137315 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:13.137764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:13.138400 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:13.139107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:13.139567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:13.140244 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:13.251586 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:13.260887 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9d9b4fc8-7727-47ea-b197-b15901574d70 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1361 microversion: 2.1 time: 0.236836 Aug 10 13:26:13.262018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 74/141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:13 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:13.371839 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:13.375531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=100 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:13.381389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-41cd1b46-2d2b-41f3-8c5d-e190766a28c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.256719 Aug 10 13:26:13.382181 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 68/142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:13 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:14.284821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:14.286801 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:14.296529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:14.298769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:14.299733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:14.300774 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:14.301919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:14.302580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:14.324738 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8de8e30f-fac0-45e3-b957-b6f0f432a87b"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:14.327171 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:14.333497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:14.334256 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:14.334829 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:14.335758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:14.336419 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:14.337128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:14.502281 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:14.510135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6b113e27-637e-4de0-a999-6bc8a301ee27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1547 microversion: 2.1 time: 0.231809 Aug 10 13:26:14.510701 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 75/143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:14 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1547 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:14.515283 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:14.515882 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:14.521613 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:14.522091 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:14.522743 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:14.523421 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:14.523938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:14.524762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:14.684679 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:14.693649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-033bba66-a973-4615-aa27-1001e86f250f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.181830 Aug 10 13:26:14.694228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 76/144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:14 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:14.702709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:14.703200 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:14.708975 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:14.709555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:14.709980 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:14.710658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:14.711135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:14.712169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:14.796110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-679100ec-b31e-4c2d-b14a-14c5ab6fdf0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098334 Aug 10 13:26:14.797133 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 77/145] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 10 13:26:14 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:15.721166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:15.721790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:15.735103 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:15.735580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:15.736014 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:15.736724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:15.737246 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:15.737662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:15.894424 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-33a27320-34f8-466a-96f0-d70a83d6eb28 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "POST /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.574259 Aug 10 13:26:15.896293 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 69/146] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:26:14 2022] POST /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee/os-volume_attachments => generated 194 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:26:15.963732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:15.971749 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-38717665-8d6c-4e99-9fe4-e76a02417368 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.254553 Aug 10 13:26:15.972259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 78/147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:15 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:16.205525 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-2c3fdc03-6059-465d-a2ca-328cc75a7326 req-f5df261e-69f0-4451-85a6-38a1af99c883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280", "tag": "5bf722b9-3a94-4cb8-b29c-ff395567c59a"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:16.217421 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-2c3fdc03-6059-465d-a2ca-328cc75a7326 req-f5df261e-69f0-4451-85a6-38a1af99c883 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:16.218160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-2c3fdc03-6059-465d-a2ca-328cc75a7326 req-f5df261e-69f0-4451-85a6-38a1af99c883 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:16.218773 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-2c3fdc03-6059-465d-a2ca-328cc75a7326 req-f5df261e-69f0-4451-85a6-38a1af99c883 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:16.231182 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-2c3fdc03-6059-465d-a2ca-328cc75a7326 req-f5df261e-69f0-4451-85a6-38a1af99c883 service nova] Creating event network-changed:5bf722b9-3a94-4cb8-b29c-ff395567c59a for instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 on hv-cinder-83602 Aug 10 13:26:16.237144 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-2c3fdc03-6059-465d-a2ca-328cc75a7326 req-f5df261e-69f0-4451-85a6-38a1af99c883 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Aug 10 13:26:16.238100 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 70/148] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:16.997081 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:17.007160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:17.020394 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=93 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:17.020394 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:17.021066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:17.021674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:17.022554 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:17.023223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:17.024921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:17.231026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:17.239250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-28412d63-fce2-428e-8443-c8b0a4649bb1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.245919 Aug 10 13:26:17.242023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 79/149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:16 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:18.264887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:18.265620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:18.271820 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:18.272304 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:18.272913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:18.273659 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:18.273934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:18.274378 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:18.416202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:18.423774 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-674b77f7-bcbb-4756-b669-2005c08b7f87 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.163650 Aug 10 13:26:18.424348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 71/150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:18 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:19.445229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:19.445860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:19.451976 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:19.452648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:19.453108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:19.453807 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:19.462353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:19.462353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:19.590410 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:19.598224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-42c321cd-dea3-4d64-a810-3fbee6b94e39 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.157324 Aug 10 13:26:19.600181 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 80/151] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:19 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:20.620038 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:20.624985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:20.627666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:20.628150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:20.628609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:20.629469 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:20.629928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:20.630399 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:20.780870 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:20.788788 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-88338c92-0554-4db0-962b-73317cf6bbcc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.173115 Aug 10 13:26:20.789560 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 72/152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:20 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:21.810274 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:21.811066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:21.817999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:21.818496 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:21.819218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:21.820932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:21.821757 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:21.822193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:22.024611 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:22.037844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5fc778e0-73bb-4096-997f-38f617454b07 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.231283 Aug 10 13:26:22.040305 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 81/153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:21 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:23.060141 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:23.060982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:23.063609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=83 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:23.077601 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:23.078318 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:23.079411 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:23.080801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:23.081841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:23.082535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:23.274453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:23.282598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a26467bf-324f-4063-a28c-76c90948ba31 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.226852 Aug 10 13:26:23.283551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 73/154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:23 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:24.305547 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:24.306235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:24.312623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:24.314432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:24.322944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:24.323773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:24.324259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:24.324702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:24.516376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:24.524594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d4942591-77bf-4da1-b806-e64db96fcced tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.222977 Aug 10 13:26:24.537449 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 82/155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:24 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:25.546281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:25.546891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:25.553196 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:25.553679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:25.554122 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:25.555423 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:25.555897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:25.556301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:25.734698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:25.742402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-eb79e137-f377-4311-aec1-3d05a40bd7ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.200192 Aug 10 13:26:25.742976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 74/156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:25 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:26.763805 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:26.764321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:26.772773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:26.774101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:26.774571 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:26.779968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:26.779968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:26.779968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:26.947402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:26.958002 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-584be491-49f7-4347-ae0c-2dc3decec822 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.198346 Aug 10 13:26:26.959365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 83/157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:26 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:27.654844 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:27.657357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:27.666939 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:27.669857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:27.669857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:27.669857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:27.669857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:27.671522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:27.723108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:26:27.979425 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:27.980091 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:27.986390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:27.986905 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:27.987349 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:27.988030 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:27.988473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:27.988908 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:28.142588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:28.150915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7fd6ec46-5067-4133-9b5a-b31db78d8c93 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.175874 Aug 10 13:26:28.151499 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 84/158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:27 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:28.409263 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3a99139f-c537-4b92-909d-627a0cc561f7 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 204 len: 0 microversion: 2.1 time: 0.757926 Aug 10 13:26:28.410187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 75/159] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:26:27 2022] DELETE /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:26:28.427122 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:28.427646 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:28.434198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:28.434673 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:28.435098 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:28.435779 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:28.436223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:28.436643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:28.583020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:28.591709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e1964add-5ecf-4e2e-9f6a-5c48c77f4f99 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1555 microversion: 2.1 time: 0.176634 Aug 10 13:26:28.592663 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 85/160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:28 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:29.180241 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:29.181259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:29.188333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:29.192017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:29.192017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:29.192017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:29.192017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:29.193507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:29.337676 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:29.351182 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e2e0cb1b-1dcd-463d-8141-1985ae8f22a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.171736 Aug 10 13:26:29.351182 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 76/161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:29 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:29.612866 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:29.613635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:29.620907 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:29.621426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:29.621860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:29.622545 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:29.623163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:29.623635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:29.792386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:29.805022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-145dee6a-1ba9-4438-8956-a12e49d678e3 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1555 microversion: 2.1 time: 0.195487 Aug 10 13:26:29.805911 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 86/162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:29 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:30.372692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:30.374762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:30.383498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:30.384383 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:30.385077 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:30.386902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:30.387370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:30.387795 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:30.616908 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:30.624545 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-45deedfa-e213-4df1-95a5-e7e5299b273c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.257872 Aug 10 13:26:30.627872 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 77/163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:30 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:30.826868 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:30.827635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:30.833700 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:30.835222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:30.836216 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:30.836954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:30.837477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:30.837890 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:30.856491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:31.068000 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:31.076233 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-53517f08-5093-49f7-b66d-9a318e18a957 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1555 microversion: 2.1 time: 0.253336 Aug 10 13:26:31.076796 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 87/164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:30 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:31.653760 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:31.655060 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:31.672328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:31.677726 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:31.678191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:31.678930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:31.679522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:31.681945 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:31.863002 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:31.878380 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1641c40d-07b2-4b53-891c-80a4c1cf3c6c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.236209 Aug 10 13:26:31.879185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 78/165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:31 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:31.906936 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-766c86dc-40bc-4cc6-a1b3-b8075a6f81da req-aa4b9efd-ade4-4c40-a877-9c4f0caf338d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee", "name": "network-vif-deleted", "tag": "032ceaa2-c6c2-4d87-a0e9-9002f6deab51"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:31.920345 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-766c86dc-40bc-4cc6-a1b3-b8075a6f81da req-aa4b9efd-ade4-4c40-a877-9c4f0caf338d service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:31.921013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-766c86dc-40bc-4cc6-a1b3-b8075a6f81da req-aa4b9efd-ade4-4c40-a877-9c4f0caf338d service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:31.921270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-766c86dc-40bc-4cc6-a1b3-b8075a6f81da req-aa4b9efd-ade4-4c40-a877-9c4f0caf338d service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:31.934885 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-766c86dc-40bc-4cc6-a1b3-b8075a6f81da req-aa4b9efd-ade4-4c40-a877-9c4f0caf338d service nova] Creating event network-vif-deleted:032ceaa2-c6c2-4d87-a0e9-9002f6deab51 for instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee on hv-cinder-83602 Aug 10 13:26:31.941472 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-766c86dc-40bc-4cc6-a1b3-b8075a6f81da req-aa4b9efd-ade4-4c40-a877-9c4f0caf338d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046259 Aug 10 13:26:31.942584 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 88/166] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:32.098119 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:32.098964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:32.107549 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:32.108392 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:32.109065 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:32.110169 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:32.110915 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:32.111343 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:32.201515 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:32.211975 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a6ffd565-4ae1-4bee-b116-8871529e8157 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1346 microversion: 2.1 time: 0.118363 Aug 10 13:26:32.212794 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 79/167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:32 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:32.910065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:32.910770 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:32.917142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:32.917629 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:32.918073 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:32.918759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:32.919219 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:32.919638 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:33.071848 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:33.081196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8c9c204b-8375-4520-a088-d786b3d432c7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.175545 Aug 10 13:26:33.082228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 89/168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:32 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:33.235873 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:33.235873 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:33.242909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:33.243396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:33.243825 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:33.244515 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:33.244963 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:33.245589 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:33.279783 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:33.280259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:33.280684 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:33.281170 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lazy-loading 'fault' on Instance uuid ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:26:33.330926 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46db4eba75f4c49a394bffe4f220fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52ecd30866b4733acd28c43adbc29a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:33.339571 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d6c96538-bba5-4e35-b480-74bfec5489ec tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 200 len: 1351 microversion: 2.1 time: 0.108632 Aug 10 13:26:33.340128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 80/169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:33 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:34.103946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:34.104558 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:34.112743 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:34.113261 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:34.113868 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:34.114762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:34.115214 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:34.115790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:34.327503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:34.341134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2485ffb6-dc53-4156-98d6-5a7456e76706 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.240234 Aug 10 13:26:34.342023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 90/170] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:34 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:34.362105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:34.362741 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:34.371380 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:34.372232 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:34.372735 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:34.373635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:34.374242 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:34.374660 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:34.390765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] HTTP exception thrown: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Request method failure captured: Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee HTTP/1.1 Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HLpSx9BomewuSwdEWf9MThlUpRY6NwkwYbgqbv1GfTbAKEjJ52Yg5h5jxL5TkXKTOxHpE8UffzTKr0buKXSsIBNckojr17cmp-_hq8g8lbypssQd3gnmvUwpXxlqtUYQb5JQOGLmq7Yi6jr8PPRrovDZ3A0GFXobLS9Weu6sNYyW8 Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: e52ecd30866b4733acd28c43adbc29a0 Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:26:34.395613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52ecd30866b4733acd28c43adbc29a0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: e52ecd30866b4733acd28c43adbc29a0 Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-DeleteServersTestJSON-1271707273-project Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: a46db4eba75f4c49a394bffe4f220fe0 Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-DeleteServersTestJSON-1271707273-project Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.401934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee'} Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:26:34.403294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.404769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.406261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Returning 404 to user: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:26:34.406261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4a55dec7-07ae-461f-9779-cd13662b7f6d tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 404 len: 111 microversion: 2.1 time: 0.039048 Aug 10 13:26:34.406261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 81/171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:34 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:26:34.549191 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:34.551431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:34.559496 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:34.565132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:34.565132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:34.565132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:34.565132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:34.565517 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:34.577069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] HTTP exception thrown: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Request method failure captured: Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee/os-volume_attachments HTTP/1.1 Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HLpSx9BomewuSwdEWf9MThlUpRY6NwkwYbgqbv1GfTbAKEjJ52Yg5h5jxL5TkXKTOxHpE8UffzTKr0buKXSsIBNckojr17cmp-_hq8g8lbypssQd3gnmvUwpXxlqtUYQb5JQOGLmq7Yi6jr8PPRrovDZ3A0GFXobLS9Weu6sNYyW8 Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: e52ecd30866b4733acd28c43adbc29a0 Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:26:34.581685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52ecd30866b4733acd28c43adbc29a0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: e52ecd30866b4733acd28c43adbc29a0 Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-DeleteServersTestJSON-1271707273-project Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: a46db4eba75f4c49a394bffe4f220fe0 Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-DeleteServersTestJSON-1271707273-project Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.582993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'server_id': 'ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee'} Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:26:34.583633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:34.585178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:34.587055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Returning 404 to user: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:26:34.587055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-aa150dd8-57a2-4560-a3f2-bd84d844fbf8 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038372 Aug 10 13:26:34.587055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 91/172] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:26:34 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:26:35.364264 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:35.364892 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:35.371606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:35.372019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:35.372456 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:35.373190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:35.373638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:35.374060 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:35.524375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:35.531943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4600afdc-6c00-4e97-b596-11d1d5afdbdf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.171577 Aug 10 13:26:35.532520 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 82/173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:35 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:36.167860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:36.168372 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:36.177088 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:36.179747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:36.179747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:36.179747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:36.179747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:36.180319 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:36.193604 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] HTTP exception thrown: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Request method failure captured: Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: DELETE /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee HTTP/1.1 Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HLpSx9BomewuSwdEWf9MThlUpRY6NwkwYbgqbv1GfTbAKEjJ52Yg5h5jxL5TkXKTOxHpE8UffzTKr0buKXSsIBNckojr17cmp-_hq8g8lbypssQd3gnmvUwpXxlqtUYQb5JQOGLmq7Yi6jr8PPRrovDZ3A0GFXobLS9Weu6sNYyW8 Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: e52ecd30866b4733acd28c43adbc29a0 Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:26:36.196724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52ecd30866b4733acd28c43adbc29a0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: e52ecd30866b4733acd28c43adbc29a0 Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-DeleteServersTestJSON-1271707273-project Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: a46db4eba75f4c49a394bffe4f220fe0 Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-DeleteServersTestJSON-1271707273-project Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.198134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee'} Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:26:36.198772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.200758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.203198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Returning 404 to user: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:26:36.203198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fc7586c2-d89e-4839-8fa4-5154776f8ad9 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 404 len: 111 microversion: 2.1 time: 0.034269 Aug 10 13:26:36.203198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 92/174] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:26:36 2022] DELETE /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:26:36.207898 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:36.207898 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] [instance: ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:36.214846 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:36.215434 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:36.215746 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:36.216430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:36.216917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:36.217314 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:36.231127 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] HTTP exception thrown: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Request method failure captured: Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee HTTP/1.1 Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HLpSx9BomewuSwdEWf9MThlUpRY6NwkwYbgqbv1GfTbAKEjJ52Yg5h5jxL5TkXKTOxHpE8UffzTKr0buKXSsIBNckojr17cmp-_hq8g8lbypssQd3gnmvUwpXxlqtUYQb5JQOGLmq7Yi6jr8PPRrovDZ3A0GFXobLS9Weu6sNYyW8 Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: e52ecd30866b4733acd28c43adbc29a0 Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:26:36.232584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52ecd30866b4733acd28c43adbc29a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52ecd30866b4733acd28c43adbc29a0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: e52ecd30866b4733acd28c43adbc29a0 Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-DeleteServersTestJSON-1271707273 Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-DeleteServersTestJSON-1271707273-project Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: a46db4eba75f4c49a394bffe4f220fe0 Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-DeleteServersTestJSON-1271707273-project Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.233747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee'} Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:26:36.234394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. Aug 10 13:26:36.235985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:26:36.237389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] Returning 404 to user: Instance ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:26:36.237389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9aa61b70-38d5-49fc-95cc-2e4f506e0f01 tempest-DeleteServersTestJSON-1271707273 tempest-DeleteServersTestJSON-1271707273-project] 10.222.0.40 "GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee" status: 404 len: 111 microversion: 2.1 time: 0.030520 Aug 10 13:26:36.237389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 83/175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:36 2022] GET /compute/v2.1/servers/ef43d0bd-84b3-45f7-834b-6b0f22cbb3ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:26:36.387179 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-4856750", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "networks": [{"uuid": "ca6b999e-04cc-4062-9bfe-bb5d5838b844"}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:36.449478 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] validate_networks() for [('ca6b999e-04cc-4062-9bfe-bb5d5838b844', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:26:36.552205 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:36.553279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:36.560649 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:36.561403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:36.561833 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:36.562728 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:36.563857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:36.564289 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:36.568645 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:36.848033 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:26:36.849644 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:26:36.850137 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:26:36.850552 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:26:36.851638 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:26:36.856264 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:36.861347 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:36.861895 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:36.862548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:36.862761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-cfc20c72-04cc-436a-b601-063d43a393b0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.314311 Aug 10 13:26:36.863733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 84/176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:36 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:36.864441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:36.864974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:36.866266 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:36.886969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Getting quotas for project e43f6ad26c6a4dcdb27c9d9ba706cd0e. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:26:36.891064 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Getting quotas for user d4e91c327d0c4b5dbae54cb915aca3e6 and project e43f6ad26c6a4dcdb27c9d9ba706cd0e. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:26:36.915548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:26:36.918436 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:26:37.078724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5dde8f14-da6b-42ab-ac9b-72b905acff8a tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697318 Aug 10 13:26:37.080322 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 93/177] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:26:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:26:37.091454 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5c17c47d-b08e-4f75-ba53-90f3656453fe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:37.092453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5c17c47d-b08e-4f75-ba53-90f3656453fe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:37.188035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5c17c47d-b08e-4f75-ba53-90f3656453fe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:37.194771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5c17c47d-b08e-4f75-ba53-90f3656453fe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1216 microversion: 2.1 time: 0.108199 Aug 10 13:26:37.195506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 85/178] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:37 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1216 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:37.886328 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:37.887313 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:37.911613 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:37.912315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:37.912947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:37.916563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:37.920731 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:37.921469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:38.107303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:38.115425 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-069573aa-9a84-46f3-a025-9facb3f7271e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.235157 Aug 10 13:26:38.116360 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 94/179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:37 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:38.216110 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b5d46bae-450a-47a8-9d0e-c2e018b3c51e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:38.216720 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b5d46bae-450a-47a8-9d0e-c2e018b3c51e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:38.281008 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b5d46bae-450a-47a8-9d0e-c2e018b3c51e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:38.301993 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b5d46bae-450a-47a8-9d0e-c2e018b3c51e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1216 microversion: 2.1 time: 0.089758 Aug 10 13:26:38.302737 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 86/180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:38 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:39.136335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:39.137299 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:39.150529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:39.151379 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:39.152170 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:39.153915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:39.155115 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:39.156054 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:39.324512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:39.325160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:39.331611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:39.332098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:39.332723 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:39.333553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:39.339389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:39.340112 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:39.400265 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:39.420590 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-57d83031-b949-4794-91f5-41177c578af4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.283890 Aug 10 13:26:39.420590 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 95/181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:39 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:39.478200 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:39.490609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f4ad5354-a661-43ca-bf94-46b9f58c0ebe tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1268 microversion: 2.1 time: 0.171702 Aug 10 13:26:39.491226 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 87/182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:39 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:40.446238 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:40.448300 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:40.461535 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:40.463082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:40.467499 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:40.473533 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:40.474567 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:40.475168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:40.513452 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:40.515067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:40.537356 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:40.537356 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:40.537356 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:40.537356 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:40.541099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:40.541628 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:40.768295 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:40.780108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-987f05fe-19dd-4e3b-9d3a-b03196b7b227 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1274 microversion: 2.1 time: 0.271466 Aug 10 13:26:40.794889 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 88/183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:40 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:40.824461 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:40.834244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b4ba0d42-7f52-4e6b-b9bb-21df80309bc1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.398283 Aug 10 13:26:40.836657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 96/184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:40 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:41.805261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:41.806143 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:41.816764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:41.817796 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:41.818339 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:41.819344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:41.820324 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:41.821978 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:41.858492 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:41.859104 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:41.865324 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:41.866202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:41.867176 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:41.867884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:41.868427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:41.868847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:42.019370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:42.041798 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8892f240-f377-4086-96db-d175c83a822c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.243228 Aug 10 13:26:42.055939 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 89/185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:41 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:42.071731 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:42.080724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b18797a1-7c3f-448e-88ba-1b11aca4fd54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.227194 Aug 10 13:26:42.081580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 97/186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:41 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:42.293280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-ad2f3978-e1ff-441d-8575-96cc19387c88 req-bbba284a-01c7-4989-bfb3-5fb5eae5a24e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad705e72-944e-4b7d-bebf-7bb535c01c15", "tag": "adcce708-4a8f-4a6c-be71-3041b69d54ec"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:42.308646 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ad2f3978-e1ff-441d-8575-96cc19387c88 req-bbba284a-01c7-4989-bfb3-5fb5eae5a24e service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:42.310174 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ad2f3978-e1ff-441d-8575-96cc19387c88 req-bbba284a-01c7-4989-bfb3-5fb5eae5a24e service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:42.311485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ad2f3978-e1ff-441d-8575-96cc19387c88 req-bbba284a-01c7-4989-bfb3-5fb5eae5a24e service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:42.325161 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-ad2f3978-e1ff-441d-8575-96cc19387c88 req-bbba284a-01c7-4989-bfb3-5fb5eae5a24e service nova] Creating event network-changed:adcce708-4a8f-4a6c-be71-3041b69d54ec for instance ad705e72-944e-4b7d-bebf-7bb535c01c15 on hv-cinder-83602 Aug 10 13:26:42.333281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-ad2f3978-e1ff-441d-8575-96cc19387c88 req-bbba284a-01c7-4989-bfb3-5fb5eae5a24e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047102 Aug 10 13:26:42.334512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 90/187] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:43.062932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:43.063719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:43.070638 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:43.071140 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:43.072110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:43.072328 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:43.072755 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:43.073212 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:43.105111 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:43.105997 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:43.113569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:43.114187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:43.118960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:43.118960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:43.118960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:43.118960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:43.278148 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:43.286100 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-32973424-69df-4568-a013-089cc0239c52 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1523 microversion: 2.1 time: 0.186229 Aug 10 13:26:43.286662 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 91/188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:43 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:43.502284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:43.510483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3011ff76-4401-4b2a-b471-77661cb1efd8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.451454 Aug 10 13:26:43.511047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 98/189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:43 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:44.306517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:44.307133 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:44.313886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:44.314547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:44.314982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:44.315739 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:44.316793 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:44.317252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:44.465557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:44.473044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ceba6ebf-1135-4035-8027-a23612e56b0a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1503 microversion: 2.1 time: 0.170752 Aug 10 13:26:44.473613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 92/190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:44 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:44.492841 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:44.493477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:44.500080 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:44.500755 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:44.501332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:44.502072 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:44.502880 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:44.503508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:44.535688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:44.536381 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:44.542561 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:44.543393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:44.543971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:44.545246 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:44.545857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:44.546431 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:44.685835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:44.693271 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-56979f2c-e8b3-42e2-b749-cac54c98e53e tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.165764 Aug 10 13:26:44.693842 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 93/191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:44 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:44.718948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:44.727068 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-93879c3a-6f8c-4d5b-8dc6-7870ccdb2d67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1515 microversion: 2.1 time: 0.238504 Aug 10 13:26:44.727645 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 99/192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:44 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:45.715098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:45.715707 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:45.723582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:45.725109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:45.726052 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:45.727687 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:45.728232 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:45.728734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:45.899635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:45.907618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-68b9994f-7910-4288-98d6-a31f0d28adb4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.196915 Aug 10 13:26:45.921927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 94/193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:45 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:46.929806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:46.931782 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:46.933877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:46.934547 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:46.943008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:46.943682 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:46.945600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:46.952924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:46.952924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:46.952924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:47.586470 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:47.602323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3dd7abaa-69af-4e86-bab1-86d6dcebdfd0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.669715 Aug 10 13:26:47.622881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 100/194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:46 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:47.715996 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:47.717500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:47.741925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:47.742432 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:47.747916 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:47.748747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:47.749258 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:47.749697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:47.807366 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lazy-loading 'flavor' on Instance uuid f649e3d1-de4b-489a-9cd9-5812f58f3258 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:26:48.262464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-91d48def-183e-4ad7-86d8-b0c63bb91c67 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258/action" status: 200 len: 32 microversion: 2.1 time: 0.552813 Aug 10 13:26:48.263772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 95/195] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:26:47 2022] POST /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258/action => generated 32 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:26:48.274225 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:48.275850 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:48.283110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:48.285984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:48.285984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:48.285984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:48.286622 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:48.287051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:48.547659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:48.556026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1c86a193-0548-4f4f-96e8-0f05bc4fdb2b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.286344 Aug 10 13:26:48.556892 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 101/196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:48 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:48.628671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=4 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:48.633436 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:48.634190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:48.641079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:48.641567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:48.642006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:48.642703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:48.643160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:48.643593 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:48.792686 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:48.803149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-30ec9719-5612-4ace-8f4f-dc3aac0937ca tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.173759 Aug 10 13:26:48.803775 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 96/197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:48 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:49.578889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:49.579534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:49.594862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:49.596383 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:49.596881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:49.597342 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:49.598043 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:49.598490 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:49.598952 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:49.828329 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:49.828949 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:49.845292 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:49.845899 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:49.846368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:49.847087 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:49.847595 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:49.847991 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:49.937237 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:49.941698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3c69a59c-7632-4313-8306-eb28e2e4de53 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.367669 Aug 10 13:26:49.956812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 102/198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:49 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:50.070322 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:50.081470 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-dd7cddab-7377-4b76-93c9-499aee1b8319 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.255720 Aug 10 13:26:50.084543 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 97/199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:49 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:50.961536 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a0b7fb92-57d5-435e-b01e-a2da9760db6a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'create', calling method: .version_select at 0x7ff6a8216820>, body: {"keypair": {"name": "tempest-keypair-221126440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9qPZeiSKxlwhydYfvLq8NWtiV7ue9Mt3GaVRHu8xf0AzhwtsHVHLM0E4mjLLWGJT7n8ErLwY8gaVHLO6lIxMGuTiHyZB5eaCXEWQsAc/IjnTE/MPzzro845qE3aKtDHA=="}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:50.969972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:50.973612 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:50.976820 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:50.977492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:50.977938 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:50.978640 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:50.979097 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:50.979521 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:50.983441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-a0b7fb92-57d5-435e-b01e-a2da9760db6a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Getting quotas for project a60a5752fcba46359ef5275f506c933a. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:26:50.987305 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-a0b7fb92-57d5-435e-b01e-a2da9760db6a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Getting quotas for user 1945fed03f73472db818c4e5ca015eb7 and project a60a5752fcba46359ef5275f506c933a. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:26:51.136634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:51.143927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6c39d8b0-ebcf-41d9-81cb-ee2a04ca9887 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.177608 Aug 10 13:26:51.152555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 98/200] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:50 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:51.160521 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a0b7fb92-57d5-435e-b01e-a2da9760db6a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.317736 Aug 10 13:26:51.161839 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 103/201] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Aug 10 13:26:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 319 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 13:26:51.163301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:51.164454 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:51.176251 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:51.176661 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:51.177091 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:51.177801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:51.178249 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:51.178703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:51.343726 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:51.352513 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fd717828-8dc7-474e-8555-c4175595df50 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.198369 Aug 10 13:26:51.353107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 99/202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:51 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:52.170631 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:52.172008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:52.179578 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:52.180778 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:52.181481 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:52.183870 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:52.188710 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:52.189951 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:52.238459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-91f522c2-cd0c-4f9e-8c0e-cfbdcda851fb req-4989d257-4972-46bb-875c-2b4938c90515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad705e72-944e-4b7d-bebf-7bb535c01c15", "name": "network-vif-plugged", "status": "completed", "tag": "adcce708-4a8f-4a6c-be71-3041b69d54ec"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:52.259902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-91f522c2-cd0c-4f9e-8c0e-cfbdcda851fb req-4989d257-4972-46bb-875c-2b4938c90515 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:52.260510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-91f522c2-cd0c-4f9e-8c0e-cfbdcda851fb req-4989d257-4972-46bb-875c-2b4938c90515 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:52.261027 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-91f522c2-cd0c-4f9e-8c0e-cfbdcda851fb req-4989d257-4972-46bb-875c-2b4938c90515 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:52.280015 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-91f522c2-cd0c-4f9e-8c0e-cfbdcda851fb req-4989d257-4972-46bb-875c-2b4938c90515 service nova] Creating event network-vif-plugged:adcce708-4a8f-4a6c-be71-3041b69d54ec for instance ad705e72-944e-4b7d-bebf-7bb535c01c15 on hv-cinder-83602 Aug 10 13:26:52.289833 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-91f522c2-cd0c-4f9e-8c0e-cfbdcda851fb req-4989d257-4972-46bb-875c-2b4938c90515 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055270 Aug 10 13:26:52.294279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 100/203] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:52.386759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:52.389193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:52.408970 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:52.415522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:52.416229 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:52.417236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:52.417711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:52.418091 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:52.481311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:52.490824 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-38e5b69e-70e9-4a15-99cd-dcfdd0ac9877 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.324777 Aug 10 13:26:52.491958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 104/204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:52 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:53.287665 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:53.296668 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-019e570d-bbc8-4e6c-adb2-daeaf6aab34c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.926035 Aug 10 13:26:53.298113 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 101/205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:52 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:53.512596 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:53.513252 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:53.520299 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:53.521012 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:53.521643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:53.523143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:53.524123 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:53.524900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:53.735682 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:53.744898 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3a311a4c-7bca-4635-920a-d1a763cc68c8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.236216 Aug 10 13:26:53.757811 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 105/206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:53 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:54.325046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:54.327399 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:54.336649 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:54.337755 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:54.338682 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:54.340568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:54.341416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:54.342075 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:54.349363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:54.661406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:54.686771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e0cf51c2-622f-4483-8dba-cf7b64facdbc tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1316 microversion: 2.1 time: 0.371552 Aug 10 13:26:54.688157 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 102/207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:54 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:54.771393 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:54.772008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:54.791546 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:54.792939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:54.793687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:54.794423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:54.794972 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:54.795284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:54.840985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-443937470", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7c1ce82-d1fa-4708-a8c1-8d792d57f953"}], "security_groups": [{"name": "tempest-securitygroup--1148104802"}], "key_name": "tempest-keypair-221126440", "user_data": "}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:54.984441 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.network.neutron [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] validate_networks() for [('c7c1ce82-d1fa-4708-a8c1-8d792d57f953', None, None, None, None, None)] {{(pid=118003) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:26:55.083736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:55.091699 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-55d554e6-d292-4167-825e-daad0f5b568a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.325678 Aug 10 13:26:55.096468 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 106/208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:54 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:55.419790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Flavor limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:26:55.420248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Image limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:26:55.420758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Flavor pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:26:55.421203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Image pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:26:55.421620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:26:55.431771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:55.432345 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:55.432919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:55.433835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:55.434487 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:55.435150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:55.452981 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Getting quotas for project a60a5752fcba46359ef5275f506c933a. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:26:55.457184 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Getting quotas for user 1945fed03f73472db818c4e5ca015eb7 and project a60a5752fcba46359ef5275f506c933a. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:26:55.469457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Going to run 1 instances... {{(pid=118003) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:26:55.471807 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:26:55.615556 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-15527001-65de-4f99-99f7-413285321e72 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.779107 Aug 10 13:26:55.622552 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 103/209] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Aug 10 13:26:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 13:26:55.628012 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9d726af7-14d4-40f0-960a-189a230d1738 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:55.628721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9d726af7-14d4-40f0-960a-189a230d1738 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:55.711517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:55.712201 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:55.712480 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d726af7-14d4-40f0-960a-189a230d1738 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:55.714301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:55.721827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:55.722299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:55.723074 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:55.725030 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:55.726856 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:55.727540 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:55.733551 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d726af7-14d4-40f0-960a-189a230d1738 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:55.733551 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d726af7-14d4-40f0-960a-189a230d1738 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:55.738624 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9d726af7-14d4-40f0-960a-189a230d1738 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1280 microversion: 2.20 time: 0.107663 Aug 10 13:26:55.739858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 107/210] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:26:55 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:26:55.906067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:55.920694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9b40c99b-fd79-4ed0-8c4e-0030291606a7 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1505 microversion: 2.1 time: 0.213940 Aug 10 13:26:55.925079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 104/211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:55 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:56.114857 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:56.114857 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:56.124971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:56.125521 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:56.125994 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:56.129789 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:56.132033 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:56.132770 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:56.552343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:56.556090 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:56.560442 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-12a7b4ea-014e-4bfa-9d4e-0e69ff3cf916 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.451847 Aug 10 13:26:56.560942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 108/212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:56 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:56.765597 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:56.765597 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:56.775069 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:56.775551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:56.775981 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:56.776675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:56.777196 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:56.778835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:56.855254 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:56.863957 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:56.866700 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:56.868165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7c356902-2ef7-445b-89e5-2ba13f2c256c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1284 microversion: 2.20 time: 0.109347 Aug 10 13:26:56.868944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 105/213] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:26:56 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:26:57.586046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:57.586732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:57.592969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:57.593473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:57.593916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:57.594608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:57.595066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:57.595497 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:57.796933 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:57.806775 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8b7f15b1-b768-4e62-8e0e-8ac73e5f324b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.223708 Aug 10 13:26:57.807420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 109/214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:57 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:57.892486 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:57.893114 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:57.900087 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:57.900571 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:57.901047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:57.901750 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:57.902208 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:57.902680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:57.998834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:58.019015 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:58.019676 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:58.020811 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fc10ed0a-53e0-4ec1-87ff-1a17e88b135d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1332 microversion: 2.20 time: 0.133013 Aug 10 13:26:58.033202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 106/215] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:26:57 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1332 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:26:58.104175 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-23137274", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "networks": [{"uuid": "329423b8-34f9-47fb-bef8-03d019e76462"}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:58.169549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] validate_networks() for [('329423b8-34f9-47fb-bef8-03d019e76462', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:26:58.732736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:26:58.733812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:26:58.740340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:26:58.740340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:26:58.740340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:26:58.744473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:58.745075 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:58.745495 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:58.746404 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:58.747444 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:58.748044 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:58.771195 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Getting quotas for project 3398675a6c1d44089f5fb2581ada3759. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:26:58.771195 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Getting quotas for user 595d22773a4d46abb87f50f4c8c058a5 and project 3398675a6c1d44089f5fb2581ada3759. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:26:58.781037 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:26:58.783188 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:26:58.829004 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:58.829621 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:58.836283 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:58.836799 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:58.837344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:58.838042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:58.838726 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:58.839451 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:59.033982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:59.042751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-dd22eb79-fffa-4389-9bb5-43a1eff51b90 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.218161 Aug 10 13:26:59.043417 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 107/216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:58 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:59.058703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:59.059414 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:59.065511 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:59.066068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:59.066571 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:59.067326 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:59.067844 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:59.068334 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:59.137909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:59.150814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:59.152734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:59.154286 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9f3ab6e2-b2e0-4a35-a25c-cf8f5fe9e9f2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1338 microversion: 2.20 time: 0.099506 Aug 10 13:26:59.154947 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 108/217] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:26:59 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:26:59.324276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-71071df5-f3fb-4953-84ea-ee194e60f635 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224122 Aug 10 13:26:59.324923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 110/218] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:26:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:26:59.336161 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8f1cb0d6-0b5c-446a-95f0-2c3f795b195b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:59.336875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8f1cb0d6-0b5c-446a-95f0-2c3f795b195b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:59.483265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8f1cb0d6-0b5c-446a-95f0-2c3f795b195b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:59.490355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8f1cb0d6-0b5c-446a-95f0-2c3f795b195b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1212 microversion: 2.1 time: 0.158545 Aug 10 13:26:59.492163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 109/219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:59 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1212 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:00.065958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:00.067601 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:00.075020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.075513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.075948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.076932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.077570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.078149 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.177928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:00.179312 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:00.188730 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.188730 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.195482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.196392 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.196967 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.197510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.270397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:00.283095 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-50518a8e-a03d-4a09-9e6b-bb5c650391e5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.218850 Aug 10 13:27:00.284004 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 111/220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:00 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:00.411547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:00.419667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:00.421602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:00.422898 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-aea9f6a3-16c1-48f2-b551-6a3ae531cc94 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.249609 Aug 10 13:27:00.423458 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 110/221] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:00 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:27:00.511714 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:00.512354 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:00.518287 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.518769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.519215 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.520342 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.521102 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.521530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.604191 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:00.620589 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-13870dc7-b841-4bda-a1a5-f1f9710e70b7 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1216 microversion: 2.1 time: 0.103914 Aug 10 13:27:00.620589 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 112/222] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:00 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1216 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:00.724572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-f84e790d-61b0-4df8-830d-ea5153ab0d54 req-41996c5b-8588-48f1-b387-5bbb5520c316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88fd6a8-9262-4f5c-9b91-ed4e70704cb9", "tag": "ea8828a3-61d3-4d2e-9d76-db0b898a6fd4"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:00.735130 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-f84e790d-61b0-4df8-830d-ea5153ab0d54 req-41996c5b-8588-48f1-b387-5bbb5520c316 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.735993 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-f84e790d-61b0-4df8-830d-ea5153ab0d54 req-41996c5b-8588-48f1-b387-5bbb5520c316 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.736677 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-f84e790d-61b0-4df8-830d-ea5153ab0d54 req-41996c5b-8588-48f1-b387-5bbb5520c316 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.749600 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-f84e790d-61b0-4df8-830d-ea5153ab0d54 req-41996c5b-8588-48f1-b387-5bbb5520c316 service nova] Creating event network-changed:ea8828a3-61d3-4d2e-9d76-db0b898a6fd4 for instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 on hv-cinder-83602 Aug 10 13:27:00.755244 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-f84e790d-61b0-4df8-830d-ea5153ab0d54 req-41996c5b-8588-48f1-b387-5bbb5520c316 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034663 Aug 10 13:27:00.758440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 111/223] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:27:01.308096 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:01.308704 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:01.315160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:01.315682 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:01.316080 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:01.316837 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:01.317246 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:01.317715 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:01.447933 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:01.452100 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:01.461616 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:01.462121 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:01.462566 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:01.463289 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:01.463765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:01.464186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:01.514667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:01.523763 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-89cbd711-f53b-44ed-8754-d9b06ba40087 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.218895 Aug 10 13:27:01.525268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 113/224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:01 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:01.647051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:01.660299 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:01.699625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:01.700128 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:01.702235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:01.703073 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:01.703553 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:01.710890 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:01.800278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:01.809156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:01.810974 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:01.812307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-adc23ce1-db45-49af-ab8e-96401b9775e4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.370751 Aug 10 13:27:01.813467 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 112/225] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:01 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:01.836455 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:01.849402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-deb0ea07-ed90-49e1-8b68-6ce6ba480b85 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1216 microversion: 2.1 time: 0.217629 Aug 10 13:27:01.851606 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 114/226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:01 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1216 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:02.546221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:02.546827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:02.557161 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:02.557557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:02.557970 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:02.559099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:02.559782 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:02.560401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:02.728748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:02.736407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-81ee4bb0-933e-4f0b-83ae-fcd723d3f91d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.193987 Aug 10 13:27:02.739326 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 113/227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:02 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:02.836786 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:02.837452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:02.844409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:02.844409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:02.844409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:02.845047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:02.845513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:02.845956 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:02.875572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:02.876437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:02.883070 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:02.883635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:02.884175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:02.884946 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:02.885511 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:02.886039 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:02.951531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:02.962819 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-821634fa-e896-44fa-9bb6-75ae10c4f4d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1264 microversion: 2.1 time: 0.089964 Aug 10 13:27:02.963411 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 114/228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:02 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1264 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:03.037685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:03.047482 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:03.049221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:03.050452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a3ac3e16-d046-4b31-9bfc-0edb35f24182 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.218436 Aug 10 13:27:03.051361 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 115/229] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:02 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:03.759022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:03.759616 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:03.769790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.773718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.773718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:03.773718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.774260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.774906 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:03.938680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:03.947384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-336395d4-26fb-490e-b280-b5e213179eff tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1501 microversion: 2.1 time: 0.193043 Aug 10 13:27:03.948068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 115/230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:03 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:03.969309 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cd644e6-ae15-4ec4-a712-3e6be0e217c8"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:03.979103 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:03.979103 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.979486 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.980180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:03.980864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.981341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.981759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:03.985299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:03.985909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:03.992397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.992891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.993363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:03.994118 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.994588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.995016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.009321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] HTTP exception thrown: Cannot 'attach_volume' instance f649e3d1-de4b-489a-9cd9-5812f58f3258 while it is in vm_state rescued Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Request method failure captured: Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: POST /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258/os-volume_attachments HTTP/1.1 Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 74 Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HI8d6dqhS5K-ZbrX184FWe_fKIHc4FnlHdDzwnLTq8-Y3JD5vSjoVyD0ZRKwi7HBpcs2JMi38-2hM5ZGw9WCKfkOWYwVBtjiwW4NDea0c2b5B7VAoskt-n6HGpwWC7Ob_NVt3sYHk6M9GNnMMsYUc7WWG-Zoyju8lMuZrQ63R0c1s Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:27:04.011022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0c9fae66a6f4ac9a0c1b0629e597906", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 4dfd3ee79da943b189824630b5c393ee Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {"volumeAttachment": {"volumeId": "2cd644e6-ae15-4ec4-a712-3e6be0e217c8"}} Aug 10 13:27:04.012420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Cannot 'attach_volume' instance f649e3d1-de4b-489a-9cd9-5812f58f3258 while it is in vm_state rescued Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'server_id': 'f649e3d1-de4b-489a-9cd9-5812f58f3258', 'body': {'volumeAttachment': {'volumeId': '2cd644e6-ae15-4ec4-a712-3e6be0e217c8'}}} Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f649e3d1-de4b-489a-9cd9-5812f58f3258 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:27:04.013498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f649e3d1-de4b-489a-9cd9-5812f58f3258 while it is in vm_state rescued Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:27:04.014813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:27:04.015971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:27:04.015971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:27:04.015971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f649e3d1-de4b-489a-9cd9-5812f58f3258 while it is in vm_state rescued Aug 10 13:27:04.015971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:27:04.015971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Returning 409 to user: Cannot 'attach_volume' instance f649e3d1-de4b-489a-9cd9-5812f58f3258 while it is in vm_state rescued {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:27:04.015971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-91517d3d-5f2c-49a4-a6aa-1504165a2714 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047339 Aug 10 13:27:04.015971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 116/231] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:27:03 2022] POST /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 13:27:04.021528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:04.022082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:04.030018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:04.033163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:04.033163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.033163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:04.033163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:04.033946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.060234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:04.067682 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6dfa619b-94e6-4d5e-ae31-ee69998da357 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1282 microversion: 2.1 time: 0.086509 Aug 10 13:27:04.070488 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 116/232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:03 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:04.075112 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:04.075721 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:04.081993 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:04.082478 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:04.082913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.083606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:04.084067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:04.084492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.216762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:04.225768 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:04.227440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:04.228568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6fc2a408-adf5-493c-b74b-7a3a571e2133 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.157115 Aug 10 13:27:04.230651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 117/233] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:04 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:04.268469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-813bd420-8486-430a-98f1-fb3fe27f7cd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258/action" status: 202 len: 0 microversion: 2.1 time: 0.250483 Aug 10 13:27:04.272950 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 117/234] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:27:04 2022] POST /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:27:04.278418 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:04.279037 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:04.285551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:04.286103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:04.286666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.287370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:04.287885 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:04.288556 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.433868 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:04.442028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c2b3e6cf-4e0d-44bc-96f8-f477a942f6f4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1509 microversion: 2.1 time: 0.167604 Aug 10 13:27:04.442531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 118/235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:04 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:05.098328 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:05.099054 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:05.117898 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:05.118475 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:05.118946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:05.119682 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:05.120140 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:05.120574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:05.199051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:05.208728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1fa7ef8b-4b1c-43d3-bf37-48057bcc8f70 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1282 microversion: 2.1 time: 0.117769 Aug 10 13:27:05.210280 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 118/236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:05 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:05.255076 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:05.255680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:05.268761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:05.269273 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:05.269710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:05.272747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:05.273590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:05.273960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:05.441991 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:05.469321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:05.472501 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:05.478692 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:05.487007 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:05.487588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:05.488417 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:05.489027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:05.489772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:05.567255 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:05.580201 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:05.582519 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:05.583908 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0c3787fa-157a-40c7-9038-0512cbec2902 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.332878 Aug 10 13:27:05.584592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 119/237] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:05 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:05.739638 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:05.748465 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dd56c5eb-8823-41ee-8d33-29dda449f465 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1509 microversion: 2.1 time: 0.283078 Aug 10 13:27:05.749875 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 119/238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:05 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:06.231673 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:06.232262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:06.238229 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.238646 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.239075 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.239751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.240197 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.240609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.466979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:06.474309 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-867f23e1-679d-4a11-903d-b178ab070b2e tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.246523 Aug 10 13:27:06.474882 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 120/239] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:06 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:06.609473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:06.610202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:06.631110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.632128 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.636906 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.637921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.638766 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.642088 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.771723 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:06.772464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:06.780949 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.781693 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.782282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.783160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.784215 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.784784 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.799658 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=100 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:06.817058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:06.826386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:06.827990 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:06.829512 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fa3850b4-762d-49ad-bbe6-a36a918d2abc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.223929 Aug 10 13:27:06.830078 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 120/240] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:06 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:06.950558 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:06.958172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0f75f56f-81ca-4cad-8e72-23b7f38754b1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1509 microversion: 2.1 time: 0.190532 Aug 10 13:27:06.958822 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 121/241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:06 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:06.999782 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-559a76a6-f6b1-4dd3-a35a-d7d9e3fff84c req-491ade6a-265e-423c-bf95-a89c5379e279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1417b2cd-dc20-45a8-94c2-3fe694823abd", "tag": "4d20e8e1-5fe5-4e74-92df-e02f169d13c7"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:07.010901 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-559a76a6-f6b1-4dd3-a35a-d7d9e3fff84c req-491ade6a-265e-423c-bf95-a89c5379e279 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:07.011659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-559a76a6-f6b1-4dd3-a35a-d7d9e3fff84c req-491ade6a-265e-423c-bf95-a89c5379e279 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:07.012145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-559a76a6-f6b1-4dd3-a35a-d7d9e3fff84c req-491ade6a-265e-423c-bf95-a89c5379e279 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:07.024728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-559a76a6-f6b1-4dd3-a35a-d7d9e3fff84c req-491ade6a-265e-423c-bf95-a89c5379e279 service nova] Creating event network-changed:4d20e8e1-5fe5-4e74-92df-e02f169d13c7 for instance 1417b2cd-dc20-45a8-94c2-3fe694823abd on hv-cinder-83602 Aug 10 13:27:07.031095 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-559a76a6-f6b1-4dd3-a35a-d7d9e3fff84c req-491ade6a-265e-423c-bf95-a89c5379e279 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034595 Aug 10 13:27:07.032196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 121/242] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:07.096565 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:07.099875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:07.110787 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:07.111279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:07.111716 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:07.112410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:07.112858 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:07.113298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:07.140429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-63d6e1d7-f523-43c5-ade3-4676f9c09bd6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/ips" status: 200 len: 150 microversion: 2.1 time: 0.047830 Aug 10 13:27:07.141042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 122/243] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:27:07 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:07.496600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:07.497407 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:07.503451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:07.503931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:07.504366 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:07.505361 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:07.505814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:07.506233 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:07.712746 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:07.720444 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-82c89c1f-a466-483b-bd84-fd5c739d3d24 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.228019 Aug 10 13:27:07.722933 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 122/244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:07 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:07.853827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:07.854955 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:07.889415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:07.890415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:07.891068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:07.891989 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:07.893105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:07.893921 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:07.998148 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:08.004387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:08.018312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:08.018935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:08.019449 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:08.020253 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:08.020705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:08.021329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:08.155318 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:08.179334 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:08.183318 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:08.184918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-045e9207-42b1-4171-987e-dad65df12701 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.336164 Aug 10 13:27:08.189911 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:08.190155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 123/245] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:07 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:08.207985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-65751a91-a780-4ed9-a2cf-426d11f83e19 req-abefa452-a4f7-420c-8dfd-b4f6d0da56d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88fd6a8-9262-4f5c-9b91-ed4e70704cb9", "name": "network-vif-plugged", "status": "completed", "tag": "ea8828a3-61d3-4d2e-9d76-db0b898a6fd4"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:08.217365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1f9527e2-4807-4ecf-9e96-57545c663c41 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1509 microversion: 2.1 time: 0.238889 Aug 10 13:27:08.230644 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 123/246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:07 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:08.234508 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-65751a91-a780-4ed9-a2cf-426d11f83e19 req-abefa452-a4f7-420c-8dfd-b4f6d0da56d3 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:08.235315 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-65751a91-a780-4ed9-a2cf-426d11f83e19 req-abefa452-a4f7-420c-8dfd-b4f6d0da56d3 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:08.236241 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-65751a91-a780-4ed9-a2cf-426d11f83e19 req-abefa452-a4f7-420c-8dfd-b4f6d0da56d3 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:08.252985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-65751a91-a780-4ed9-a2cf-426d11f83e19 req-abefa452-a4f7-420c-8dfd-b4f6d0da56d3 service nova] Creating event network-vif-plugged:ea8828a3-61d3-4d2e-9d76-db0b898a6fd4 for instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 on hv-cinder-83602 Aug 10 13:27:08.259376 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-65751a91-a780-4ed9-a2cf-426d11f83e19 req-abefa452-a4f7-420c-8dfd-b4f6d0da56d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071130 Aug 10 13:27:08.260253 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 124/247] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:08.741871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:08.742329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:08.748282 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:08.752946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:08.752946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:08.752946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:08.752946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:08.753296 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:08.755867 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:08.776615 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=12 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:08.896346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1ffd9b4-a05d-4a08-96a5-a76114e953fe"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:08.900489 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:08.907781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:08.908272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:08.908966 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:08.909863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:08.910388 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:08.911110 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:09.228213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:09.236897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3614a2cb-4677-4232-8c17-2e08c51e564b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.499526 Aug 10 13:27:09.238048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 124/248] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:08 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:09.244044 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:09.244791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:09.251995 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:09.252559 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:09.253163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:09.253864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:09.254320 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:09.254748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:09.401968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:09.410568 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:09.413544 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:09.414800 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-54be21b1-e686-421e-ac05-6a5f2531b60a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.175650 Aug 10 13:27:09.415861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 125/249] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:09 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:09.420576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:09.421229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:09.429017 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:09.430001 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:09.430692 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:09.431624 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:09.432194 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:09.432698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:09.437304 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:09.489538 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=8 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:09.593421 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:09.605695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3a2282a8-bcf5-4976-a7c4-24f74772fcee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1515 microversion: 2.1 time: 0.187107 Aug 10 13:27:09.605695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 126/250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:09 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:09.749647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c05ea4cf-d3b7-47c3-996f-6dca0b71a41e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857890 Aug 10 13:27:09.750238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 125/251] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:27:08 2022] POST /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:10.260850 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:10.261511 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:10.267947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:10.268434 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:10.268866 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:10.270495 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:10.270495 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:10.270495 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:10.443427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:10.445220 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:10.445957 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:10.453659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-157e92ce-56c7-408d-abde-dc8e9f864332 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.196660 Aug 10 13:27:10.454944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 127/252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:10 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:10.474189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:10.474974 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:10.478502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:10.479528 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:10.479996 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:10.480429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:10.640640 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:10.655739 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:10.657770 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:10.659355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b4e6dfc9-1e56-445d-9a0e-3446d7ab56ee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.223430 Aug 10 13:27:10.659925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 126/253] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:10 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:11.480274 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:11.480274 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:11.484255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:11.484807 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:11.485332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:11.486077 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:11.486503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:11.486887 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:11.626791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:11.634562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-70f0b166-4d7d-4997-b60b-667826f80483 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.162609 Aug 10 13:27:11.635137 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 128/254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:11 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:11.682355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:11.684278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:11.691144 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:11.691865 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:11.699240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:11.699240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:11.699240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:11.699240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:11.727794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1df92364-d214-493e-8ba6-d0df4b7c4ff8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'create', calling method: .version_select at 0x7ff6a8273b80>, body: {"keypair": {"name": "tempest-keypair-1804757345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhGvI7t+dNQZ4KasUP+dXu2gn6dTAcZzCSVVbpg9UufLTkCSICflDvQDG211H6jx2rKz9ytmgnkNKpLCMqLivkgasbuvdFfGMl2kfA7srpzrg0vKaZCW/rE+j6jjD77Xw=="}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:11.744404 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-1df92364-d214-493e-8ba6-d0df4b7c4ff8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Getting quotas for project c0c9fae66a6f4ac9a0c1b0629e597906. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:27:11.748344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-1df92364-d214-493e-8ba6-d0df4b7c4ff8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Getting quotas for user 4dfd3ee79da943b189824630b5c393ee and project c0c9fae66a6f4ac9a0c1b0629e597906. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:27:11.816315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1df92364-d214-493e-8ba6-d0df4b7c4ff8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092757 Aug 10 13:27:11.816931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 129/255] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:27:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:27:11.833553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:11.842714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:11.844341 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:11.845690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b3c4e215-f38b-4735-b6ae-5cd8284fd1ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1406 microversion: 2.20 time: 0.167533 Aug 10 13:27:11.846441 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 127/256] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:11 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:27:12.063549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:12.064031 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:12.072912 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:12.073431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:12.077441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:12.078340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:12.078992 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:12.079572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:12.108555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-aa5de992-814f-419a-be68-f9bcef390c88 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/ips" status: 200 len: 145 microversion: 2.1 time: 0.055025 Aug 10 13:27:12.114414 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 130/257] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:27:12 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/ips => generated 145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:12.655883 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:12.656486 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:12.666396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:12.666919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:12.667372 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:12.668052 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:12.668506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:12.668925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:12.820350 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:12.827727 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-960d1713-8050-411a-b418-d548c67d4699 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.175936 Aug 10 13:27:12.828294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 128/258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:12 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:12.874812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:12.875414 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:12.882091 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:12.882581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:12.883046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:12.883725 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:12.884174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:12.884595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:13.018689 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:13.027545 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:13.029064 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:13.030204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3984c822-871c-4696-b0df-ad2a32c4f67d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1599 microversion: 2.20 time: 0.159299 Aug 10 13:27:13.030756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 131/259] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:27:12 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:27:13.052702 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:13.053306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:13.059806 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:13.060298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:13.060729 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:13.061466 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:13.061924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:13.064780 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:13.165599 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fe205b42-1100-4d24-92fa-540f86e20c97 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.116948 Aug 10 13:27:13.166209 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 129/260] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Aug 10 13:27:13 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:27:13.853851 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:13.854837 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:13.861331 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:13.861814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:13.862238 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:13.863198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:13.863852 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:13.864474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:14.076262 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:14.084029 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-131638b2-9d2f-4ee0-a7af-31d7d21fce5d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.238347 Aug 10 13:27:14.085515 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 132/261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:13 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:14.222914 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1915542310", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cc4f7a8-eb4f-4476-bc15-27d7da2ccfc9"}], "security_groups": [{"name": "tempest-securitygroup--1214539256"}], "key_name": "tempest-keypair-1804757345", "user_data": "}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:14.394219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.network.neutron [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] validate_networks() for [('3cc4f7a8-eb4f-4476-bc15-27d7da2ccfc9', None, None, None, None, None)] {{(pid=118003) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:27:14.933021 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-1edb4d9a-a4a9-4e2b-923d-55818dd3b734 req-4d9c143f-c747-4700-9855-2aa54cef0010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88fd6a8-9262-4f5c-9b91-ed4e70704cb9", "tag": "ea8828a3-61d3-4d2e-9d76-db0b898a6fd4"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:14.943041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1edb4d9a-a4a9-4e2b-923d-55818dd3b734 req-4d9c143f-c747-4700-9855-2aa54cef0010 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:14.943530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1edb4d9a-a4a9-4e2b-923d-55818dd3b734 req-4d9c143f-c747-4700-9855-2aa54cef0010 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:14.944150 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1edb4d9a-a4a9-4e2b-923d-55818dd3b734 req-4d9c143f-c747-4700-9855-2aa54cef0010 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:14.957218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-1edb4d9a-a4a9-4e2b-923d-55818dd3b734 req-4d9c143f-c747-4700-9855-2aa54cef0010 service nova] Creating event network-changed:ea8828a3-61d3-4d2e-9d76-db0b898a6fd4 for instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 on hv-cinder-83602 Aug 10 13:27:14.965101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-1edb4d9a-a4a9-4e2b-923d-55818dd3b734 req-4d9c143f-c747-4700-9855-2aa54cef0010 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035259 Aug 10 13:27:14.966788 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 133/262] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:27:15.049325 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Flavor limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:27:15.049750 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Image limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:27:15.050224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Flavor pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:27:15.050711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Image pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:27:15.051162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:27:15.060495 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:15.060977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:15.061783 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:15.062578 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:15.063245 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:15.063675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:15.080674 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Getting quotas for project c0c9fae66a6f4ac9a0c1b0629e597906. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:27:15.085473 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Getting quotas for user 4dfd3ee79da943b189824630b5c393ee and project c0c9fae66a6f4ac9a0c1b0629e597906. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:27:15.107861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:15.108558 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:15.113053 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Going to run 1 instances... {{(pid=118003) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:27:15.115201 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:15.115784 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:27:15.117539 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:15.118293 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:15.118734 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:15.119603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:15.120075 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:15.120523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:15.234514 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1e3e06de-3e10-4751-90a4-c9bc34383652 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.017078 Aug 10 13:27:15.238570 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 130/263] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:27:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:27:15.257282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-91f7ed6b-b1d8-40d8-98b3-cac3b4bba677 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:15.258304 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-91f7ed6b-b1d8-40d8-98b3-cac3b4bba677 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:15.298529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:15.307848 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5fe230ac-51d2-42d4-91ce-2af20fb8b507 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.205315 Aug 10 13:27:15.308964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 134/264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:15 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:15.376420 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-91f7ed6b-b1d8-40d8-98b3-cac3b4bba677 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:15.384094 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-91f7ed6b-b1d8-40d8-98b3-cac3b4bba677 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1246 microversion: 2.1 time: 0.132195 Aug 10 13:27:15.384676 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 131/265] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:15 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1246 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:16.331629 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:16.332588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:16.343026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:16.344005 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:16.344881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:16.345921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:16.346555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:16.347119 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:16.414657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:16.420652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:16.424293 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:16.424864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:16.425337 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:16.426092 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:16.427398 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:16.427834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:16.508694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:16.517453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ff6a77e0-bea9-4459-aabd-b31ee9e303a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1242 microversion: 2.1 time: 0.109845 Aug 10 13:27:16.518041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 132/266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:16 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:16.591892 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:16.601416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ded20528-8c86-499b-bb53-148375fdafab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.276703 Aug 10 13:27:16.614930 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 135/267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:16 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:16.952782 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-7abcbfd0-e0fc-4a86-955f-d2c1f6cd220d req-613f0e11-d0d3-44e0-a2ec-609614ee97e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1417b2cd-dc20-45a8-94c2-3fe694823abd", "name": "network-vif-plugged", "status": "completed", "tag": "4d20e8e1-5fe5-4e74-92df-e02f169d13c7"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:16.962253 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7abcbfd0-e0fc-4a86-955f-d2c1f6cd220d req-613f0e11-d0d3-44e0-a2ec-609614ee97e4 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:16.962731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7abcbfd0-e0fc-4a86-955f-d2c1f6cd220d req-613f0e11-d0d3-44e0-a2ec-609614ee97e4 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:16.963159 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7abcbfd0-e0fc-4a86-955f-d2c1f6cd220d req-613f0e11-d0d3-44e0-a2ec-609614ee97e4 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:16.974224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-7abcbfd0-e0fc-4a86-955f-d2c1f6cd220d req-613f0e11-d0d3-44e0-a2ec-609614ee97e4 service nova] Creating event network-vif-plugged:4d20e8e1-5fe5-4e74-92df-e02f169d13c7 for instance 1417b2cd-dc20-45a8-94c2-3fe694823abd on hv-cinder-83602 Aug 10 13:27:16.979695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-7abcbfd0-e0fc-4a86-955f-d2c1f6cd220d req-613f0e11-d0d3-44e0-a2ec-609614ee97e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030621 Aug 10 13:27:16.980364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 133/268] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:27:17.539439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:17.540056 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:17.546138 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:17.546752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:17.547213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:17.547994 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:17.548456 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:17.548897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:17.627021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:17.627475 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:17.627587 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:17.632666 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-daa90091-7436-48ca-b1ff-80005271b9cc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1298 microversion: 2.1 time: 0.097256 Aug 10 13:27:17.633279 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 136/269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:17 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:17.640547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:17.641062 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:17.641523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:17.642193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:17.642646 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:17.643068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:17.801570 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:17.810233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8d9b6f69-8a6a-47c3-b24f-360af6f67857 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.191222 Aug 10 13:27:17.811078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 134/270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:17 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:18.203897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d7610e8-519e-4e21-a7c1-db2ea3b78277"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:18.206407 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:18.212405 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:18.212886 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:18.213359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:18.214044 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:18.214502 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:18.214925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:18.653115 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:18.653717 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:18.660863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:18.661519 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:18.662032 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:18.663383 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:18.663887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:18.664367 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:18.734470 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:18.742502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-57867c47-bba6-4dbf-a05d-b94d34fd096c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1316 microversion: 2.1 time: 0.093225 Aug 10 13:27:18.743070 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 135/271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:18 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1316 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:18.832259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:18.833026 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:18.840413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:18.840846 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:18.841336 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:18.842030 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:18.842478 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:18.843034 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:19.041491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f41268f8-4ef3-4ca2-bdbf-4a3d2312596c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841340 Aug 10 13:27:19.042276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 137/272] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:27:18 2022] POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:19.049943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bcd2b76a-3c55-4d2d-9742-bffce5949b52 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: .version_select at 0x7ff6a8433550>, body: {"keypair": {"name": "tempest-keypair-1819910416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmDUjuiQfF2pkueXqjFtCcRS/sbOMxoJ7YaN5RAqXycbpMW+g4oQ1Lukg8iYKN9BG2U2oMr8xwT00hqObqIKzkUZNsrV0ifpJW1VvKfJ3ostH4i+KZKltoOeXVJDlfc/Q=="}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:19.057179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:19.064975 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4d4c8218-17b2-4e5d-a2e7-b17a9bae7553 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.237177 Aug 10 13:27:19.065577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 136/273] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:18 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:19.073129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-bcd2b76a-3c55-4d2d-9742-bffce5949b52 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for project 26a97b47cc804e598c5e8680d279de19. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:27:19.074247 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-bcd2b76a-3c55-4d2d-9742-bffce5949b52 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for user c9577bc4c4c546ca9fc220ebd3a16346 and project 26a97b47cc804e598c5e8680d279de19. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:27:19.158176 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-bcd2b76a-3c55-4d2d-9742-bffce5949b52 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114443 Aug 10 13:27:19.159061 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 138/274] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:27:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:19.768546 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:19.775517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:19.786252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:19.787065 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:19.791592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:19.791592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:19.791592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:19.791592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:20.046994 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:20.065213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9ac95d15-e2e3-4d97-b749-9e24c61039fb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.295351 Aug 10 13:27:20.065213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 137/275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:19 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:20.088884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:20.100956 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:20.108665 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:20.109437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:20.110191 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:20.111158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:20.111803 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:20.112341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:20.283965 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:20.292169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ac543d8e-00f7-44ab-9574-721bcde57fcc tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1312 microversion: 2.1 time: 0.209596 Aug 10 13:27:20.292755 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 139/276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:20 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1312 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:21.082715 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:21.083329 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:21.091123 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:21.091603 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:21.092035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:21.092729 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:21.093212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:21.093635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:21.262776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:21.271053 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f0661384-201f-4fa4-83c5-04f75211c5d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.192157 Aug 10 13:27:21.271628 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 138/277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:21 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:21.313155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:21.313869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:21.321416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:21.322029 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:21.322566 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:21.323391 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:21.326536 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:21.326536 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:21.525716 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:21.533202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6ea99661-fc73-4f38-ad79-07876a5aaac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1495 microversion: 2.1 time: 0.224156 Aug 10 13:27:21.534025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 140/278] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:21 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1495 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:21.590607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-0bb16a35-7bbd-4e83-8649-f05889221c77 req-da8dfe4e-6731-42c5-bb36-7cd6d4ad295b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0788538-19b6-4d2b-ab3f-521dbd8cc729", "tag": "0687467f-3bdd-446f-8a4c-8b0ab78e9c63"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:21.600944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-0bb16a35-7bbd-4e83-8649-f05889221c77 req-da8dfe4e-6731-42c5-bb36-7cd6d4ad295b service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:21.601652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-0bb16a35-7bbd-4e83-8649-f05889221c77 req-da8dfe4e-6731-42c5-bb36-7cd6d4ad295b service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:21.602250 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-0bb16a35-7bbd-4e83-8649-f05889221c77 req-da8dfe4e-6731-42c5-bb36-7cd6d4ad295b service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:21.618664 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-0bb16a35-7bbd-4e83-8649-f05889221c77 req-da8dfe4e-6731-42c5-bb36-7cd6d4ad295b service nova] Creating event network-changed:0687467f-3bdd-446f-8a4c-8b0ab78e9c63 for instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 on hv-cinder-83602 Aug 10 13:27:21.635983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-0bb16a35-7bbd-4e83-8649-f05889221c77 req-da8dfe4e-6731-42c5-bb36-7cd6d4ad295b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049019 Aug 10 13:27:21.636891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 139/279] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:21.669229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff1bccc4-1ff5-4740-82bc-f6d02a3db497", "device": "/dev/sdb"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:21.672855 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:21.688866 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:21.689889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:21.690484 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:21.691584 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:21.692219 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:21.692648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:21.743783 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-756063621", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0166bef-5b21-4630-8f39-894ba8f20530"}], "security_groups": [{"name": "tempest-securitygroup--646454986"}], "key_name": "tempest-keypair-1819910416", "user_data": "}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:21.893712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.network.neutron [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] validate_networks() for [('e0166bef-5b21-4630-8f39-894ba8f20530', None, None, None, None, None)] {{(pid=118003) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:27:22.525984 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Flavor limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:27:22.526641 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Image limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:27:22.527036 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Flavor pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:27:22.527509 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Image pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:27:22.527935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:27:22.543702 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:22.549228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:22.549228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:22.549228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:22.549228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:22.549764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:22.554342 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-88965824-3eee-417d-b1c5-d1a93106f732 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "POST /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888609 Aug 10 13:27:22.567259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for project 26a97b47cc804e598c5e8680d279de19. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:27:22.568118 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:22.570917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for user c9577bc4c4c546ca9fc220ebd3a16346 and project 26a97b47cc804e598c5e8680d279de19. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:27:22.578434 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 141/280] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:27:21 2022] POST /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:22.597488 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Going to run 1 instances... {{(pid=118003) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:27:22.597488 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:27:22.597859 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:22.606378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:22.619559 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:22.619937 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:22.620384 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:22.621371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:22.622061 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:22.622649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:22.732751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b5aeb285-95e2-4136-9ffa-9b609c13643d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.994138 Aug 10 13:27:22.736605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 140/281] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:27:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:27:22.751386 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:22.751896 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:22.759346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:22.765098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:22.765098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:22.765098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:22.765098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:22.765459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:22.818320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:22.833740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:27:22.878367 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:22.905289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-671267c6-d912-4213-a304-260a55372f5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.323138 Aug 10 13:27:22.906060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 142/282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:22 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:22.924892 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ab5dc329-fa08-40e3-a421-221548ff39b5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:22.925689 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ab5dc329-fa08-40e3-a421-221548ff39b5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:22.983456 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ab5dc329-fa08-40e3-a421-221548ff39b5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:22.990245 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ab5dc329-fa08-40e3-a421-221548ff39b5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1241 microversion: 2.1 time: 0.069124 Aug 10 13:27:22.991677 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 143/283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:22 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:23.156089 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7498994f-6939-46ed-bd1f-c2bbaf450a02 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 204 len: 0 microversion: 2.1 time: 0.418159 Aug 10 13:27:23.156710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 141/284] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:27:22 2022] DELETE /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:27:23.166053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:23.166666 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:23.173450 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:23.173942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:23.174468 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:23.175289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:23.175646 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:23.176090 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:23.182000 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:23.313961 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:23.325602 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4bf77692-76f6-4c1b-a377-39f6af6f1442 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1501 microversion: 2.1 time: 0.164211 Aug 10 13:27:23.337060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 144/285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:23 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:23.928635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:23.929448 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:23.935524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:23.936006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:23.936441 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:23.937169 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:23.937622 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:23.938043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:24.019825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:24.020517 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:24.029009 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:24.035094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:24.035094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:24.035094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:24.035094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:24.035474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:24.079815 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:24.087999 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a5afe03e-c4fb-46f3-85a8-0cf03a7ba62f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.164616 Aug 10 13:27:24.089474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 142/286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:23 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:24.099737 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:24.108925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-623f129d-4644-4c9a-a63a-439cf93cf473 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1245 microversion: 2.1 time: 0.093763 Aug 10 13:27:24.109533 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 145/287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:24 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:24.348196 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:24.348801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:24.356019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:24.356507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:24.356942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:24.357670 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:24.358129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:24.358556 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:24.506967 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:24.514893 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f13a7376-f871-4ac0-9aa5-7d1c3bab5ec8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1501 microversion: 2.1 time: 0.170482 Aug 10 13:27:24.515640 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 143/288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:24 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:25.109444 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:25.110129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:25.117860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:25.118370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:25.118848 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:25.119648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:25.120145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:25.120607 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:25.130037 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:25.130857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:25.138292 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:25.138920 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:25.139425 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:25.140206 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:25.140748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:25.141268 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:25.208171 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:25.216268 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ad8ee093-a9e4-455a-93dc-019732273853 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1245 microversion: 2.1 time: 0.090726 Aug 10 13:27:25.220323 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 144/289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:25 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:25.266465 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:25.275306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-88d521fe-0472-4ba5-b8a6-95fef0395d46 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.169673 Aug 10 13:27:25.276078 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 146/290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:25 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:25.540928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:25.541560 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:25.552022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:25.552506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:25.552934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:25.553702 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:25.554281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:25.554688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:25.690557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:25.698607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3ff6a5da-6462-40db-a498-10dd852c1d88 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1501 microversion: 2.1 time: 0.166707 Aug 10 13:27:25.699167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 145/291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:25 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:26.237194 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:26.237801 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:26.244467 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:26.245129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:26.245668 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:26.246360 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:26.246814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:26.247235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:26.297534 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:26.298147 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:26.304881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:26.305396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:26.305897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:26.306595 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:26.307105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:26.307532 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:26.312234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:26.320386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3bc13607-31a4-48db-821f-88233c4ea79b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1245 microversion: 2.1 time: 0.087100 Aug 10 13:27:26.320947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 147/292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:26 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:26.440541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:26.448531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2d9b1504-e502-4d81-a80b-62e179ef00fa tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.154791 Aug 10 13:27:26.449131 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 146/293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:26 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:26.719491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:26.720098 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:26.726167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:26.726649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:26.727086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:26.727768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:26.728253 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:26.728676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:26.862771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:26.872266 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8f00ee38-73fe-4f39-9888-a0bb3b1d5ac5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1501 microversion: 2.1 time: 0.156469 Aug 10 13:27:26.873036 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 148/294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:26 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:26.992134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-4cc4a356-5dce-4220-a31d-c121daefd7b6 req-fcb5e5e2-4dc9-4722-b5ed-a69dd5bb7826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0788538-19b6-4d2b-ab3f-521dbd8cc729", "name": "network-vif-plugged", "status": "completed", "tag": "0687467f-3bdd-446f-8a4c-8b0ab78e9c63"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:27.002375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4cc4a356-5dce-4220-a31d-c121daefd7b6 req-fcb5e5e2-4dc9-4722-b5ed-a69dd5bb7826 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:27.002914 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4cc4a356-5dce-4220-a31d-c121daefd7b6 req-fcb5e5e2-4dc9-4722-b5ed-a69dd5bb7826 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:27.004829 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4cc4a356-5dce-4220-a31d-c121daefd7b6 req-fcb5e5e2-4dc9-4722-b5ed-a69dd5bb7826 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:27.016349 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-4cc4a356-5dce-4220-a31d-c121daefd7b6 req-fcb5e5e2-4dc9-4722-b5ed-a69dd5bb7826 service nova] Creating event network-vif-plugged:0687467f-3bdd-446f-8a4c-8b0ab78e9c63 for instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 on hv-cinder-83602 Aug 10 13:27:27.020883 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-4cc4a356-5dce-4220-a31d-c121daefd7b6 req-fcb5e5e2-4dc9-4722-b5ed-a69dd5bb7826 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033049 Aug 10 13:27:27.021508 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 147/295] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:27.340979 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:27.341618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:27.348283 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:27.348843 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:27.349578 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:27.350965 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:27.351587 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:27.352178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:27.431923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:27.442036 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0080ce22-2f59-4a4e-86f0-1f81747f6ade tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1237 microversion: 2.1 time: 0.104939 Aug 10 13:27:27.442667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 149/296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:27 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:27.479661 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:27.480352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:27.486677 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:27.487155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:27.487585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:27.488261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:27.488709 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:27.489158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:27.627803 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:27.635482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8bf1da43-758c-46b8-a374-f1c3a3889ba9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.160951 Aug 10 13:27:27.636029 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 148/297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:27 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:27.899105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:27.899725 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:27.906612 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:27.907058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:27.907500 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:27.908199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:27.909150 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:27.909578 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:28.053047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:28.061381 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fe0aaa4d-7d8a-4208-8897-97bd9cd24090 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1501 microversion: 2.1 time: 0.167064 Aug 10 13:27:28.061979 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 150/298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:27 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:28.323288 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-1f86b819-c743-41f1-9146-5cc07d5a4ff7 req-f0afd16f-f8b6-4f88-a8a3-f0611285d84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1417b2cd-dc20-45a8-94c2-3fe694823abd", "name": "network-vif-deleted", "tag": "4d20e8e1-5fe5-4e74-92df-e02f169d13c7"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:28.336016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1f86b819-c743-41f1-9146-5cc07d5a4ff7 req-f0afd16f-f8b6-4f88-a8a3-f0611285d84e service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:28.336875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1f86b819-c743-41f1-9146-5cc07d5a4ff7 req-f0afd16f-f8b6-4f88-a8a3-f0611285d84e service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:28.337348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1f86b819-c743-41f1-9146-5cc07d5a4ff7 req-f0afd16f-f8b6-4f88-a8a3-f0611285d84e service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:28.349616 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-1f86b819-c743-41f1-9146-5cc07d5a4ff7 req-f0afd16f-f8b6-4f88-a8a3-f0611285d84e service nova] Creating event network-vif-deleted:4d20e8e1-5fe5-4e74-92df-e02f169d13c7 for instance 1417b2cd-dc20-45a8-94c2-3fe694823abd on hv-cinder-83602 Aug 10 13:27:28.355142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-1f86b819-c743-41f1-9146-5cc07d5a4ff7 req-f0afd16f-f8b6-4f88-a8a3-f0611285d84e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035529 Aug 10 13:27:28.355860 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 149/299] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:28.464498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:28.465048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:28.471409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:28.471892 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:28.472333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:28.473057 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:28.473516 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:28.473942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:28.536300 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:28.544586 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-72e47033-8cf4-4ad2-92b9-8250b1f3986d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1293 microversion: 2.1 time: 0.084651 Aug 10 13:27:28.545198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 151/300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:28 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:28.656154 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:28.657257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:28.665519 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:28.666232 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:28.681017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:28.682702 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:28.683340 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:28.683790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:28.839666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:28.851531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ca30d1a2-52d9-449d-86d2-e68063ed61c6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.199296 Aug 10 13:27:28.852240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 150/301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:28 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:28.915528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4bde4312-2a03-4cd3-b596-652eb96319a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:28.921636 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bde4312-2a03-4cd3-b596-652eb96319a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:28.922120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bde4312-2a03-4cd3-b596-652eb96319a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:28.922564 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bde4312-2a03-4cd3-b596-652eb96319a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:28.988861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4bde4312-2a03-4cd3-b596-652eb96319a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Going to try to stop instance {{(pid=118002) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 13:27:29.082875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:29.083518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:29.090791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.091279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.091708 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:29.092422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.092870 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.093319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:29.127564 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.128042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.128471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:29.128912 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lazy-loading 'fault' on Instance uuid 1417b2cd-dc20-45a8-94c2-3fe694823abd {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:27:29.175985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:29.183515 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-13794263-ded5-43df-b9ec-43573ceecb08 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1302 microversion: 2.1 time: 0.104767 Aug 10 13:27:29.184064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 151/302] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:29 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:29.296279 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4bde4312-2a03-4cd3-b596-652eb96319a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/action" status: 202 len: 0 microversion: 2.1 time: 0.384467 Aug 10 13:27:29.297104 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 152/303] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:27:28 2022] POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:27:29.305699 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:29.306312 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:29.312164 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.312636 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.313094 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:29.313772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.314221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.314641 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:29.556980 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:29.565294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1fee4171-6b12-4167-a5ab-d3cd7f5f7149 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.264085 Aug 10 13:27:29.565863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 152/304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:29 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:29.567733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:29.568429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:29.575257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.575739 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.576178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:29.576872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.577354 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.577781 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:29.642090 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:29.651319 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d928d0e6-e026-44d8-a741-bee8e3907b49 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1311 microversion: 2.1 time: 0.088364 Aug 10 13:27:29.651894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 153/305] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:29 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:29.872177 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:29.933632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:29.933632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.933632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.933632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:29.934079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:29.934079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:29.934079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:30.017466 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:30.027512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-80193540-6b1c-470b-9ce8-262efc02e373 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1372 microversion: 2.1 time: 0.158919 Aug 10 13:27:30.028108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 153/306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:29 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:30.204581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:30.205256 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:30.212140 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:30.212678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:30.213161 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:30.213860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:30.214313 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:30.214744 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:30.246448 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:30.246934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:30.247367 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:30.247811 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lazy-loading 'fault' on Instance uuid 1417b2cd-dc20-45a8-94c2-3fe694823abd {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:27:30.296068 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:30.304166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c290aa8d-ea8a-4a9f-a1d0-04cdc7560a9b tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1302 microversion: 2.1 time: 0.103598 Aug 10 13:27:30.304726 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 154/307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:30 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:30.587733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:30.588338 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:30.594810 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:30.595360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:30.595817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:30.596516 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:30.596968 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:30.598203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:30.673116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:30.673731 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:30.680888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:30.684154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:30.684154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:30.684154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:30.684154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:30.684594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:30.747768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:30.756058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b1d7604f-b2a3-44da-bb34-1461e4975a73 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1299 microversion: 2.1 time: 0.086774 Aug 10 13:27:30.757767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 155/308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:30 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:30.808942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:30.818038 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a4456351-fb9c-49c1-9a11-a5c00ca78085 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.234686 Aug 10 13:27:30.818879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 154/309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:30 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:31.049156 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:31.049763 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:31.055762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.056277 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.056754 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.057474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.057925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.058349 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.226442 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:31.234341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-bfec633d-f8b2-4d16-97bc-8c1c1025dde9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1566 microversion: 2.1 time: 0.189101 Aug 10 13:27:31.234917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 156/310] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:31 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:31.255882 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:31.256460 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:31.263248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.263734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.264169 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.264863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.265376 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.265801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.326208 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:31.327105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:31.333953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.334452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.335593 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.336620 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.337099 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.337527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.353095 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-14d25f84-eb18-4ebf-9a57-94a32467ae4a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101197 Aug 10 13:27:31.354063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 155/311] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 10 13:27:31 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:31.372224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.372714 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.373338 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.373948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lazy-loading 'fault' on Instance uuid 1417b2cd-dc20-45a8-94c2-3fe694823abd {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:27:31.441595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:31.450583 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d9c8d5a5-4962-4cdc-9b4d-8fcb4ad78752 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 200 len: 1302 microversion: 2.1 time: 0.129537 Aug 10 13:27:31.451287 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 157/312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:31 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 1302 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:31.780307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:31.781040 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:31.796738 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.797174 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.797796 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.798732 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.799184 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.799781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.845250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:31.846899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:31.862720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.863204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.863635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:31.864334 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:31.864784 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:31.865234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:32.097400 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:32.100450 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f38b85ae-d1d3-46f0-9786-a1c625f1f604 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.324441 Aug 10 13:27:32.101052 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 156/313] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:31 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:32.211621 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:32.230672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4aeeb0d4-b13a-4212-9fdb-8b90eed7350e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.393880 Aug 10 13:27:32.231266 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 158/314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:31 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:32.471931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:32.473533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 1417b2cd-dc20-45a8-94c2-3fe694823abd] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:32.481279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:32.487428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:32.487428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:32.487428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:32.487428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:32.487920 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:32.502586 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] HTTP exception thrown: Instance 1417b2cd-dc20-45a8-94c2-3fe694823abd could not be found. Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Request method failure captured: Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd HTTP/1.1 Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87Ig6sf0H5jAgMJ25KtOrkziU1hoSH754Jkw4WCWnxvri2CVjjUuKKyhi6rA-phwEa6_AEV15n9DfIWp6H6-8wNS6nFVWvpM-dC5HeHpsxUxzRfo2_gi-TSPhK952N3wt6PxB7iFPhWFydVkg89cZNRzMzQgBKyaP5L25wnyMiB9uYM Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 3398675a6c1d44089f5fb2581ada3759 Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-VolumesActionsTest-234506854 Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:27:32.504410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3398675a6c1d44089f5fb2581ada3759"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3398675a6c1d44089f5fb2581ada3759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3398675a6c1d44089f5fb2581ada3759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3398675a6c1d44089f5fb2581ada3759", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-VolumesActionsTest-234506854 Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 3398675a6c1d44089f5fb2581ada3759 Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-VolumesActionsTest-234506854 Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-VolumesActionsTest-234506854-project Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 595d22773a4d46abb87f50f4c8c058a5 Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-VolumesActionsTest-234506854-project Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 1417b2cd-dc20-45a8-94c2-3fe694823abd could not be found. Aug 10 13:27:32.516193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '1417b2cd-dc20-45a8-94c2-3fe694823abd'} Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1417b2cd-dc20-45a8-94c2-3fe694823abd could not be found. Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:27:32.517019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1417b2cd-dc20-45a8-94c2-3fe694823abd could not be found. Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1417b2cd-dc20-45a8-94c2-3fe694823abd could not be found. Aug 10 13:27:32.518222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:27:32.520485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Returning 404 to user: Instance 1417b2cd-dc20-45a8-94c2-3fe694823abd could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:27:32.520485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-39f4e32d-799a-4245-a3cd-5e3c33f9def9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd" status: 404 len: 111 microversion: 2.1 time: 0.038000 Aug 10 13:27:32.520485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 157/315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:32 2022] GET /compute/v2.1/servers/1417b2cd-dc20-45a8-94c2-3fe694823abd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:27:32.628036 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1430688859", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "networks": [{"uuid": "329423b8-34f9-47fb-bef8-03d019e76462"}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:32.691334 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] validate_networks() for [('329423b8-34f9-47fb-bef8-03d019e76462', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:27:32.768348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-a4746c1c-9966-479d-b558-b7ab76bbc840 req-54ba3773-7bc0-4ab7-a952-43819b1a81a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b", "tag": "44b3fb3b-e0d3-4232-9bd8-9e71e32368f8"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:32.778437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=4 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:32.779485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=14 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:32.781919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-a4746c1c-9966-479d-b558-b7ab76bbc840 req-54ba3773-7bc0-4ab7-a952-43819b1a81a8 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:32.784653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-a4746c1c-9966-479d-b558-b7ab76bbc840 req-54ba3773-7bc0-4ab7-a952-43819b1a81a8 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:32.784653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-a4746c1c-9966-479d-b558-b7ab76bbc840 req-54ba3773-7bc0-4ab7-a952-43819b1a81a8 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:32.797188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-a4746c1c-9966-479d-b558-b7ab76bbc840 req-54ba3773-7bc0-4ab7-a952-43819b1a81a8 service nova] Creating event network-changed:44b3fb3b-e0d3-4232-9bd8-9e71e32368f8 for instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b on hv-cinder-83602 Aug 10 13:27:32.802760 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-a4746c1c-9966-479d-b558-b7ab76bbc840 req-54ba3773-7bc0-4ab7-a952-43819b1a81a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038263 Aug 10 13:27:32.805440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 158/316] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:27:32.900006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-ff9d5fed-4d5b-437d-887a-f5bc36e9f65e req-5c0d6ba7-918b-44b3-bc22-fce4e18365b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0788538-19b6-4d2b-ab3f-521dbd8cc729", "tag": "0687467f-3bdd-446f-8a4c-8b0ab78e9c63"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:32.911635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ff9d5fed-4d5b-437d-887a-f5bc36e9f65e req-5c0d6ba7-918b-44b3-bc22-fce4e18365b0 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:32.912420 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ff9d5fed-4d5b-437d-887a-f5bc36e9f65e req-5c0d6ba7-918b-44b3-bc22-fce4e18365b0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:32.913099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ff9d5fed-4d5b-437d-887a-f5bc36e9f65e req-5c0d6ba7-918b-44b3-bc22-fce4e18365b0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:32.917521 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:32.927195 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-ff9d5fed-4d5b-437d-887a-f5bc36e9f65e req-5c0d6ba7-918b-44b3-bc22-fce4e18365b0 service nova] Creating event network-changed:0687467f-3bdd-446f-8a4c-8b0ab78e9c63 for instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 on hv-cinder-83602 Aug 10 13:27:32.933248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-ff9d5fed-4d5b-437d-887a-f5bc36e9f65e req-5c0d6ba7-918b-44b3-bc22-fce4e18365b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038641 Aug 10 13:27:32.934379 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 159/317] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:27:32.995962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=10 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:33.127498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:33.128931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:33.144567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:33.145628 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:33.146224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:33.147920 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:33.148540 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:33.149242 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:33.347703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:33.361159 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-784709d6-2976-45fd-9de5-12dd0ce8e4cd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.240542 Aug 10 13:27:33.367943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 160/318] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:33 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:33.372355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:33.378458 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:33.391651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:33.392303 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:33.392841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:33.393773 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:33.394351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:33.401619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:27:33.401619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:27:33.401619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:27:33.401619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:27:33.401619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:27:33.402662 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:33.409481 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:33.410180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:33.410791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:33.411750 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:33.412561 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:33.413768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:33.424449 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:33.435740 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Getting quotas for project 3398675a6c1d44089f5fb2581ada3759. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:27:33.440129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Getting quotas for user 595d22773a4d46abb87f50f4c8c058a5 and project 3398675a6c1d44089f5fb2581ada3759. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:27:33.453690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:27:33.456485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:27:33.630565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2fd44281-d7ba-46c7-bd53-70b1e86deb5a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006379 Aug 10 13:27:33.631577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 159/319] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:27:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:27:33.677579 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-16fc9b32-029e-401b-b790-d4f165da22ec tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:33.678232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-16fc9b32-029e-401b-b790-d4f165da22ec tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:33.707886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:33.719163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-854290e9-36e0-4958-99f9-7e15c6bd225b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.350639 Aug 10 13:27:33.723472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 161/320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:33 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:33.766939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-16fc9b32-029e-401b-b790-d4f165da22ec tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:33.778326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-16fc9b32-029e-401b-b790-d4f165da22ec tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1214 microversion: 2.1 time: 0.135202 Aug 10 13:27:33.778930 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 160/321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:33 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:34.387611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:34.388219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:34.394828 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:34.395311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:34.395744 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:34.396435 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:34.396891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:34.401881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:34.553940 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:34.561840 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0ef4c2be-10f3-47ce-98e6-e627d24d0589 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.178265 Aug 10 13:27:34.562405 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 162/322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:34 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:34.742608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:34.743218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:34.750697 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:34.751185 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:34.751621 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:34.752383 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:34.752844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:34.753298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:34.802162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:34.804310 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:34.809959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:34.810468 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:34.811618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:34.812341 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:34.812801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:34.813414 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:34.881352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:34.887999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:34.889544 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ec99f41d-b061-4e3c-8321-7f9429cf0937 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1218 microversion: 2.1 time: 0.091312 Aug 10 13:27:34.890124 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 163/323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:34 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:34.896209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-38714001-e900-48cd-8f57-e9e69903e1f5 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.158287 Aug 10 13:27:34.896750 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 161/324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:34 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:35.583058 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:35.583657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:35.591174 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:35.591662 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:35.592205 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:35.592951 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:35.593451 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:35.593877 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:35.735474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:35.743814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b307089b-6cc6-4ceb-876b-6d2882ff3f1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.164590 Aug 10 13:27:35.744375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 164/325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:35 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:35.910532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:35.911146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:35.916870 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:35.917657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:35.918072 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:35.918557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:35.919090 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:35.919753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:35.920209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:35.920641 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:35.923460 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:35.923938 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:35.924375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:35.925092 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:35.925547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:35.929246 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:35.989689 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:35.998998 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fa067a21-9532-48fc-8ed1-36b0b5bbbc51 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1218 microversion: 2.1 time: 0.092476 Aug 10 13:27:36.004193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 162/326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:35 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:36.058750 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:36.066690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d20ee466-305f-4503-a988-00ec3dd4dd27 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.153688 Aug 10 13:27:36.067252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 165/327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:35 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:36.765379 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:36.765985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:36.771929 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:36.772423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:36.772874 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:36.773602 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:36.774048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:36.774463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:36.904127 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:36.911665 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-30b0c5ff-9111-49f9-8399-4573bacb58c2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.150252 Aug 10 13:27:36.912257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 163/328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:36 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:37.023789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:37.024423 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:37.031884 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:37.032385 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:37.032832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:37.033742 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:37.034470 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:37.034908 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:37.090656 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:37.091387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:37.098888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:37.098888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:37.099268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:37.099968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:37.100590 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:37.101094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:37.101417 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:37.108809 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-61fbc9b5-0aa6-4429-adcb-e05d49234d1a tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1218 microversion: 2.1 time: 0.089735 Aug 10 13:27:37.109406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 166/329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:37 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:37.233313 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:37.242565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cdaabdbe-c7ad-4805-b788-3b774a6b770c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.155493 Aug 10 13:27:37.245095 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 164/330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:37 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:37.933787 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:37.934407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:37.940648 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:37.941168 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:37.941610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:37.942344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:37.942801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:37.943223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:38.078917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:38.087044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-795d9d43-9100-4f42-a86e-f8c4e29d980e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.157627 Aug 10 13:27:38.087609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 167/331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:37 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:38.129828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:38.130437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:38.137679 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:38.138166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:38.138603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:38.139312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:38.139768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:38.140193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:38.204683 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:38.211985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e08240e5-dc21-4040-8842-8037f91487d0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1218 microversion: 2.1 time: 0.086247 Aug 10 13:27:38.212548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 165/332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:38 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:38.263668 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:38.264276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:38.270089 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:38.270567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:38.271001 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:38.271683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:38.272137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:38.273142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:38.406611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:38.415535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3b06fd28-90f6-43a5-bb7e-ea7a233d3049 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.155755 Aug 10 13:27:38.416098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 168/333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:38 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:39.107775 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:39.108382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:39.114418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:39.114900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:39.115335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:39.116028 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:39.116855 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:39.117060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:39.232202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:39.232806 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:39.239916 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:39.240391 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:39.241731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:39.242062 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:39.242243 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:39.242828 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:39.255230 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:39.265532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a8fa9a7c-fda8-4d93-b8f9-325582848ab4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.161451 Aug 10 13:27:39.279783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 166/334] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:39 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:39.312166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:39.319488 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-dafb02b0-52d9-428e-a143-13e29c7ac9a6 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1218 microversion: 2.1 time: 0.091193 Aug 10 13:27:39.320408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 169/335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:39 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:39.439036 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:39.439652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:39.446275 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:39.446761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:39.447211 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:39.447904 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:39.448362 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:39.448785 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:39.577933 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:39.586759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1c2861ec-8c50-4f40-b8d0-4fe852b6a8ee tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.151636 Aug 10 13:27:39.587338 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 167/336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:39 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:40.287736 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:40.288651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:40.295085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:40.295571 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:40.296040 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:40.296731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:40.297217 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:40.297642 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:40.339899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:40.340505 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:40.342988 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:40.347822 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:40.348312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:40.348741 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:40.349475 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:40.349927 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:40.350349 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:40.419033 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:40.426251 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3327b0f8-6879-4a7c-b545-7460ac84cc13 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1210 microversion: 2.1 time: 0.090374 Aug 10 13:27:40.426814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 168/337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:40 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:40.441413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:40.449643 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5d788d79-0c84-4f8a-98ab-5dd7a0f4100f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.166030 Aug 10 13:27:40.450209 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 170/338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:40 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:40.609027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:40.609652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:40.615975 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:40.617090 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:40.617543 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:40.618267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:40.618725 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:40.619330 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:40.772824 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:40.781786 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-442a98d5-6126-4380-820b-5175bc08595d tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.176832 Aug 10 13:27:40.783318 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 169/339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:40 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:41.142575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-e4889bdd-6f35-41f5-96ab-829b14c85ed3 req-82887f74-5def-44c5-a79f-15bbdcd81473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b", "name": "network-vif-plugged", "status": "completed", "tag": "44b3fb3b-e0d3-4232-9bd8-9e71e32368f8"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:41.153251 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-e4889bdd-6f35-41f5-96ab-829b14c85ed3 req-82887f74-5def-44c5-a79f-15bbdcd81473 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:41.153728 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-e4889bdd-6f35-41f5-96ab-829b14c85ed3 req-82887f74-5def-44c5-a79f-15bbdcd81473 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:41.154141 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-e4889bdd-6f35-41f5-96ab-829b14c85ed3 req-82887f74-5def-44c5-a79f-15bbdcd81473 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:41.166412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-e4889bdd-6f35-41f5-96ab-829b14c85ed3 req-82887f74-5def-44c5-a79f-15bbdcd81473 service nova] Creating event network-vif-plugged:44b3fb3b-e0d3-4232-9bd8-9e71e32368f8 for instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b on hv-cinder-83602 Aug 10 13:27:41.171261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-e4889bdd-6f35-41f5-96ab-829b14c85ed3 req-82887f74-5def-44c5-a79f-15bbdcd81473 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032373 Aug 10 13:27:41.171832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 171/340] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:41.449969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:41.450395 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:41.456775 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:41.457285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:41.457749 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:41.458444 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:41.459070 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:41.459642 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:41.471406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:41.474048 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:41.485305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:41.485923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:41.486507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:41.487364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:41.487819 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:41.488240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:41.556630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:41.567116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3344b581-685a-426f-b1e4-0d877940863c tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1274 microversion: 2.1 time: 0.122854 Aug 10 13:27:41.567852 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 170/341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:41 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:41.716470 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:41.724011 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7345a3ac-05d7-453e-b22c-f6d17143ed06 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.257980 Aug 10 13:27:41.724575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 172/342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:41 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:41.804448 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:41.805139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:41.811045 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:41.811534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:41.811974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:41.812733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:41.813232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:41.813662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:41.985198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:41.994675 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2daa8623-50fa-4897-a53e-4d3548a96311 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.194377 Aug 10 13:27:42.005528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 171/343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:41 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:42.589442 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:42.589979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:42.596267 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:42.596743 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:42.597221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:42.597907 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:42.598359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:42.598780 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:42.731476 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:42.740744 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0aecd842-3fc6-4bc6-bdcd-72ab8caf8bab tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.155715 Aug 10 13:27:42.742163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 173/344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:42 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:42.746099 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:42.751055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:42.753970 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:42.754451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:42.755083 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:42.755782 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:42.756236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:42.757372 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:42.894818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:42.902850 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-214f2890-affc-491c-a471-27f5ed7c8eae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.161910 Aug 10 13:27:42.903543 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 172/345] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:42 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:43.017168 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:43.017777 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:43.024343 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:43.024832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:43.029740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:43.029740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:43.029740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:43.029740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:43.186621 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:43.198003 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a7290d88-22e2-41a6-b83a-f497131c17ea tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.184656 Aug 10 13:27:43.209160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 174/346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:43 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:43.482084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-04a278bf-ed73-416b-b3c4-e13ed1adcbc7 req-326cc748-cafe-4f3c-af13-aa55403fe112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f314995-d604-4312-9210-5f633d99a69e", "tag": "6624db2b-09f7-4db8-aa38-e9bcdca4f99c"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:43.486926 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:43.492306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-04a278bf-ed73-416b-b3c4-e13ed1adcbc7 req-326cc748-cafe-4f3c-af13-aa55403fe112 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:43.495109 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-04a278bf-ed73-416b-b3c4-e13ed1adcbc7 req-326cc748-cafe-4f3c-af13-aa55403fe112 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:43.495109 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-04a278bf-ed73-416b-b3c4-e13ed1adcbc7 req-326cc748-cafe-4f3c-af13-aa55403fe112 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:43.504428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-04a278bf-ed73-416b-b3c4-e13ed1adcbc7 req-326cc748-cafe-4f3c-af13-aa55403fe112 service nova] Creating event network-changed:6624db2b-09f7-4db8-aa38-e9bcdca4f99c for instance 6f314995-d604-4312-9210-5f633d99a69e on hv-cinder-83602 Aug 10 13:27:43.509578 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-04a278bf-ed73-416b-b3c4-e13ed1adcbc7 req-326cc748-cafe-4f3c-af13-aa55403fe112 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030757 Aug 10 13:27:43.509790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 173/347] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:43.762926 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:43.763559 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:43.769926 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:43.776371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:43.776371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:43.776371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:43.776371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:43.776926 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:43.905770 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:43.914129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9b6e0682-5e25-453a-99a5-0ccc1fa7f9dd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.154998 Aug 10 13:27:43.914632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 175/348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:43 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:43.924587 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:43.925345 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:43.927801 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=8 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:43.934520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:43.935010 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:43.935448 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:43.936185 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:43.936647 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:43.937106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:44.071356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:44.078771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8aa97309-38f6-4758-8302-f9abe737719f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.158658 Aug 10 13:27:44.079443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 174/349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:43 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:44.219649 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:44.220189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:44.226158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:44.226640 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:44.227075 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:44.227759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:44.228218 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:44.228647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:44.361807 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:44.370761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-518e837f-172d-4f2d-b793-a2f7e9cbfacf tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.155066 Aug 10 13:27:44.371321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 176/350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:44 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:44.934816 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:44.935427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:44.941863 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:44.942345 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:44.942782 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:44.943464 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:44.943917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:44.946677 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:45.073299 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:45.080800 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d9c63f2f-92c0-47e0-9e34-6da5ab259011 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.149880 Aug 10 13:27:45.081403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 175/351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:44 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:45.099486 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:45.100122 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:45.106919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:45.107403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:45.107838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:45.108522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:45.108972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:45.109424 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:45.113485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=100 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:45.238558 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:45.246816 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ec8bb088-ada4-418f-8040-486f4d930475 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.151125 Aug 10 13:27:45.247389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 177/352] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:45 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:45.391595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:45.392207 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:45.399143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:45.399633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:45.400073 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:45.400764 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:45.401250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:45.401680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:45.532724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:45.541546 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7ab3daa0-7820-4a5e-9e78-ee4561253db2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.153822 Aug 10 13:27:45.542104 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 176/353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:45 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:46.101628 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:46.102269 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:46.108764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:46.109267 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:46.109698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:46.110378 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:46.110944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:46.111368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:46.242211 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:46.249512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7687d03d-ecf5-4bf7-bfd5-ea7a66bd30a2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.151837 Aug 10 13:27:46.250068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 178/354] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:46 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:46.268097 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:46.268713 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:46.275072 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:46.275562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:46.275999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:46.276688 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:46.277180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:46.277608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:46.407643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:46.415437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fd7995c9-ee8c-4fa7-9d80-569b62b5af1f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1366 microversion: 2.1 time: 0.151184 Aug 10 13:27:46.416006 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 177/355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:46 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:46.563404 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:46.564079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:46.571047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:46.571542 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:46.571992 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:46.572711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:46.573315 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:46.577821 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:46.708814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:46.720262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ce5ddf40-e26f-488f-8479-38680e9afc89 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.160342 Aug 10 13:27:46.725260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 179/356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:46 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:47.270063 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:47.270674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:47.277767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:47.278249 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:47.278685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:47.279370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:47.279824 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:47.280247 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:47.284438 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:47.413182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:47.420598 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7444a80d-61e4-494a-8d36-d2bcc961e0e2 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.154517 Aug 10 13:27:47.421198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 178/357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:47 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:47.435626 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:47.436221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:47.442619 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:47.443090 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:47.443515 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:47.444192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:47.444642 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:47.445775 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:47.663894 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:47.672375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-43a5f32e-a0db-40ab-ae4b-14ac09e27482 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1556 microversion: 2.1 time: 0.240503 Aug 10 13:27:47.672944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 180/358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:47 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:47.696353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:47.696856 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:47.702921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:47.703610 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:47.704053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:47.704756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:47.705239 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:47.705665 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:47.745497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:47.746114 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:47.752940 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:47.754539 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:47.754975 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:47.755831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:47.756470 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:47.757085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:47.832428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-24c08614-e164-4ae6-b404-e5631ab08681 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140614 Aug 10 13:27:47.833037 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 179/359] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 10 13:27:47 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:47.993127 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:48.003722 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3f08a650-3a29-4b80-94e1-26050a65af2e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.263172 Aug 10 13:27:48.005983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 181/360] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:47 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:48.441014 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:48.441864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:48.448387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:48.448934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:48.449437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:48.450138 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:48.450580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:48.451004 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:48.937880 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:48.945110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1f9340fc-24b3-408c-87d2-cb2ac706cd2d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.508578 Aug 10 13:27:48.945855 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 180/361] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:48 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:49.030610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:49.031213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:49.033628 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:49.038410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:49.040008 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:49.040618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:49.041354 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:49.041807 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:49.042230 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:49.184093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:49.196841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d8ff7c52-8e1e-44ce-ab27-4a73e125f107 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.170072 Aug 10 13:27:49.199496 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 182/362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:49 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:49.231801 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-6d8388de-23f2-4b2b-8fb1-480bdd91fb09 req-ddd4e932-ba8d-4fc6-8600-d40569c67722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b", "tag": "44b3fb3b-e0d3-4232-9bd8-9e71e32368f8"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:49.241887 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-6d8388de-23f2-4b2b-8fb1-480bdd91fb09 req-ddd4e932-ba8d-4fc6-8600-d40569c67722 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:49.242550 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-6d8388de-23f2-4b2b-8fb1-480bdd91fb09 req-ddd4e932-ba8d-4fc6-8600-d40569c67722 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:49.243378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-6d8388de-23f2-4b2b-8fb1-480bdd91fb09 req-ddd4e932-ba8d-4fc6-8600-d40569c67722 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:49.257549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-6d8388de-23f2-4b2b-8fb1-480bdd91fb09 req-ddd4e932-ba8d-4fc6-8600-d40569c67722 service nova] Creating event network-changed:44b3fb3b-e0d3-4232-9bd8-9e71e32368f8 for instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b on hv-cinder-83602 Aug 10 13:27:49.263638 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-6d8388de-23f2-4b2b-8fb1-480bdd91fb09 req-ddd4e932-ba8d-4fc6-8600-d40569c67722 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037277 Aug 10 13:27:49.264591 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 181/363] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:27:49.966393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:49.967036 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:49.973606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:49.974098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:49.974534 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:49.975429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:49.975891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:49.976357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:50.118035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:50.126098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b02091b6-2efd-4d98-b172-c673f899022d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.163653 Aug 10 13:27:50.126675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 183/364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:49 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:50.222428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:50.223256 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:50.235318 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:50.235805 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:50.236238 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:50.236931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:50.237409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:50.237827 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:50.372148 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:50.380284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d4c0ba30-86f4-4314-8271-f2f3f7a5e16a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.162540 Aug 10 13:27:50.380847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 182/365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:50 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:51.147655 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:51.148244 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:51.154680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:51.155164 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:51.155598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:51.156284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:51.156736 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:51.157190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:51.289165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:51.296610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ffb94466-838f-4a26-804c-82586b9b154d tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.152801 Aug 10 13:27:51.297186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 184/366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:51 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:51.402049 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:51.402692 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:51.409397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:51.409884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:51.410320 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:51.411007 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:51.411463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:51.411886 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:51.542423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:51.550421 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9377c074-00c0-4a6d-8535-5cd8929c7d02 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.152344 Aug 10 13:27:51.550988 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 183/367] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:51 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:52.317836 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:52.318407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:52.325940 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:52.326420 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:52.326904 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:52.327588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:52.328042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:52.328461 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:52.461017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:52.468368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-54fbcb96-7622-43a9-b4ad-00411e1eff79 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.154561 Aug 10 13:27:52.468946 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 185/368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:52 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:52.571646 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:52.572180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:52.578560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:52.579042 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:52.579481 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:52.580167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:52.580622 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:52.581080 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:52.712736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:52.720773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-228b5c9d-bf3c-4128-bab0-cad10068b4a2 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.153698 Aug 10 13:27:52.721364 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 184/369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:52 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:53.489402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:53.489987 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:53.497317 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:53.500854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:53.500854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:53.500854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:53.500854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:53.501676 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:53.640491 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:53.647878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-91ef6c0c-f15b-4322-ad35-a363e20ded17 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.162536 Aug 10 13:27:53.648437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 186/370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:53 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:53.741574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:53.742172 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:53.749224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:53.749702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:53.750147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:53.750818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:53.751272 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:53.751695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:53.882583 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:53.891137 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3c978bcf-3e8b-459e-9aa0-893d5e2ce5db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.153524 Aug 10 13:27:53.891700 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 185/371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:53 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:54.669280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:54.669930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:54.676386 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:54.676931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:54.677466 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:54.678149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:54.678603 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:54.679029 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:54.811168 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:54.818587 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b7bf123d-d007-4ec3-9daf-e8fbc3bfc345 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.153346 Aug 10 13:27:54.819147 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 187/372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:54 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:54.912351 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:54.912940 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:54.920126 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:54.920629 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:54.921097 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:54.921779 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:54.922234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:54.922651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:55.052329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:55.061143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-06341280-2136-471f-b38f-179aebd19ec6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.152769 Aug 10 13:27:55.061733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 186/373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:54 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:55.839269 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:55.839796 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:55.846099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:55.846575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:55.847002 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:55.847676 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:55.848125 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:55.848539 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:55.977606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:55.986802 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f18a352d-87d8-47ef-9d77-89fc98527347 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.151018 Aug 10 13:27:55.987593 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 188/374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:55 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:56.082848 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:56.083453 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:56.090505 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:56.090912 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:56.091340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:56.092017 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:56.092465 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:56.092879 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:56.222423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:56.231051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f956ace4-af83-4575-982e-4379b8e816e4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.152017 Aug 10 13:27:56.231617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 187/375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:56 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:57.008639 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:57.009205 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:57.016527 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:57.017024 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:57.017466 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:57.018149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:57.018596 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:57.019136 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:57.160317 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:57.167870 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-dd4c3f24-e903-44ca-8d66-288aa093bfcd tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.163320 Aug 10 13:27:57.168429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 189/376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:57 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:57.251652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:57.252264 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:57.258528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:57.259060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:57.259445 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:57.260127 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:57.261517 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:57.261968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:57.392660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:57.400477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b32a2346-c1a2-40cd-8667-45c97797a00f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.152621 Aug 10 13:27:57.401047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 188/377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:57 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:58.188401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:58.189026 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:58.195406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:58.195892 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:58.196322 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:58.197003 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:58.197480 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:58.197922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:58.330607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:58.338133 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1f62a987-81aa-4e4b-81b1-d995f746bb78 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.153642 Aug 10 13:27:58.339319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 190/378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:58 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:58.423085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:58.423721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:58.430121 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:58.430603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:58.431041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:58.431728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:58.432189 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:58.432791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:58.564557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:58.572494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0dc337a5-345e-4ec1-95c1-4a1e8581371e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1721 microversion: 2.1 time: 0.153387 Aug 10 13:27:58.573595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 189/379] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:58 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:59.360275 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:59.361166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:59.367702 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:59.368203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:59.368698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:59.369360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:59.369841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:59.370275 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:59.576976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:59.585938 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-af446e8e-efc7-42fb-b13e-154deb660801 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.229600 Aug 10 13:27:59.586602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 191/380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:59 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:59.595498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:59.596690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:59.603818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:59.605213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:59.605984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:59.606860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:59.607360 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:59.614205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:59.772186 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:59.782069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6519694f-024b-494f-9e1e-041fc9c7c41b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1698 microversion: 2.1 time: 0.189407 Aug 10 13:27:59.783381 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 190/381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:59 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:59.811771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0e7aa85e-4a86-4553-8e76-ea803917c1dd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:59.818432 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e7aa85e-4a86-4553-8e76-ea803917c1dd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:59.819283 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e7aa85e-4a86-4553-8e76-ea803917c1dd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:59.819780 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0e7aa85e-4a86-4553-8e76-ea803917c1dd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:59.890751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0e7aa85e-4a86-4553-8e76-ea803917c1dd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Going to try to start instance {{(pid=118003) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 13:28:00.002254 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:00.138044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0e7aa85e-4a86-4553-8e76-ea803917c1dd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/action" status: 202 len: 0 microversion: 2.1 time: 0.330578 Aug 10 13:28:00.138547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 192/382] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:27:59 2022] POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:28:00.146806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:00.147525 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:00.153728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:00.154298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:00.154739 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:00.155452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:00.155895 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:00.156323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:00.295899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:00.308184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0dc026aa-6f07-4fed-b245-5fa3334c2896 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1707 microversion: 2.1 time: 0.164676 Aug 10 13:28:00.309358 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 191/383] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:00 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1707 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:00.613551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:00.614242 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:00.620978 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:00.621492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:00.621928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:00.622614 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:00.623065 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:00.623483 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:00.892545 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:00.900836 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-aaeb4313-3f5a-41c2-af8a-354b23e339b8 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.292021 Aug 10 13:28:00.901883 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 193/384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:00 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:01.330949 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:01.331522 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:01.338139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:01.339267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:01.339267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:01.339958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:01.340416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:01.340870 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:01.410464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-089c1649-f4d2-4112-aec2-a2273117bfd1 req-3cbbf19e-ae15-4d25-8c6f-46ceb569facb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f314995-d604-4312-9210-5f633d99a69e", "name": "network-vif-plugged", "status": "completed", "tag": "6624db2b-09f7-4db8-aa38-e9bcdca4f99c"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:01.423007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-089c1649-f4d2-4112-aec2-a2273117bfd1 req-3cbbf19e-ae15-4d25-8c6f-46ceb569facb service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:01.423533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-089c1649-f4d2-4112-aec2-a2273117bfd1 req-3cbbf19e-ae15-4d25-8c6f-46ceb569facb service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:01.424069 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-089c1649-f4d2-4112-aec2-a2273117bfd1 req-3cbbf19e-ae15-4d25-8c6f-46ceb569facb service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:01.437034 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-089c1649-f4d2-4112-aec2-a2273117bfd1 req-3cbbf19e-ae15-4d25-8c6f-46ceb569facb service nova] Creating event network-vif-plugged:6624db2b-09f7-4db8-aa38-e9bcdca4f99c for instance 6f314995-d604-4312-9210-5f633d99a69e on hv-cinder-83602 Aug 10 13:28:01.442084 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-089c1649-f4d2-4112-aec2-a2273117bfd1 req-3cbbf19e-ae15-4d25-8c6f-46ceb569facb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036582 Aug 10 13:28:01.444443 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 194/385] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:28:01.484900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:01.493255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c12aa396-2e15-4bf0-a313-320f711066ec tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1707 microversion: 2.1 time: 0.166585 Aug 10 13:28:01.493825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 192/386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:01 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1707 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:01.932792 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:01.933540 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:01.939737 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:01.942757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:01.942757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:01.942757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:01.942757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:01.943132 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:02.081822 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:02.090533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-de8f2052-964f-45f2-b471-a705737594d9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.162391 Aug 10 13:28:02.091510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 195/387] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:01 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:02.515786 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:02.517021 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:02.525144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:02.530118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:02.530118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:02.530118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:02.530118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:02.530551 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:02.666207 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:02.674727 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d6ef890a-291a-46e5-b7ec-7d91cc8d84f4 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1711 microversion: 2.1 time: 0.163133 Aug 10 13:28:02.675292 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 193/388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:02 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:03.111838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:03.112611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:03.119055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:03.119534 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:03.119972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:03.120662 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:03.121148 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:03.121576 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:03.253591 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:03.264363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-92f83574-ba01-419a-a0d0-75d306a108c3 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.156381 Aug 10 13:28:03.264895 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 196/389] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:03 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:03.283968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:03.284756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:03.290760 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:03.291233 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:03.291659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:03.292337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:03.292780 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:03.293930 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:03.420159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lazy-loading 'services' on Instance uuid ad705e72-944e-4b7d-bebf-7bb535c01c15 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:28:03.672729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-65e7ec76-a5fa-4675-86fc-bcd03185318d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15/os-volume_attachments/ff1bccc4-1ff5-4740-82bc-f6d02a3db497" status: 202 len: 0 microversion: 2.1 time: 0.390784 Aug 10 13:28:03.672729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 194/390] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:28:03 2022] DELETE /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15/os-volume_attachments/ff1bccc4-1ff5-4740-82bc-f6d02a3db497 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:28:04.285536 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:04.286152 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:04.293570 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:04.293955 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:04.294376 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:04.295280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:04.295868 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:04.296333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:04.434643 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:04.442078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ab65a828-ca2b-4f37-b5a2-c2876a82feb5 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1314 microversion: 2.1 time: 0.160761 Aug 10 13:28:04.442649 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 197/391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:04 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:05.464069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:05.464712 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:05.472435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:05.472918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:05.473427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:05.474120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:05.474574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:05.475005 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:05.479080 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:05.615152 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:05.623941 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dbe8ffbe-dba3-4855-98b2-85d746818c9f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1498 microversion: 2.1 time: 0.163112 Aug 10 13:28:05.627462 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 195/392] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:05 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:05.880172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:05.880710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:05.887450 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:05.887926 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:05.889740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:05.890583 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:05.891037 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:05.891463 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:05.921756 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:28:06.207314 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f15ab605-e32b-4c9e-8604-c2943370d996 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 204 len: 0 microversion: 2.1 time: 0.330906 Aug 10 13:28:06.208005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 198/393] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:28:05 2022] DELETE /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:28:06.217730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:06.218331 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:06.225452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:06.225452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:06.225452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:06.226125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:06.226727 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:06.227146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:06.361388 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:06.368873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b51baa9d-8a2f-4b0c-8aa1-71f979933c24 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1511 microversion: 2.1 time: 0.155648 Aug 10 13:28:06.369474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 196/394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:06 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:06.606537 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:06.607312 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:06.613275 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:06.613761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:06.614189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:06.614906 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:06.615518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:06.616120 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:06.643625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:28:06.916262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a01b28cb-133a-4b79-bc8c-d940eb463ee0 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 204 len: 0 microversion: 2.1 time: 0.313814 Aug 10 13:28:06.916914 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 199/395] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:28:06 2022] DELETE /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:28:06.926431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:06.927050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:06.933921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:06.934417 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:06.934851 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:06.936468 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:06.936660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:06.937124 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:07.078905 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:07.086451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-71cbae32-71fd-443d-9989-246d46607245 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1504 microversion: 2.1 time: 0.163957 Aug 10 13:28:07.087020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 197/396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:06 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:07.390866 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:07.391549 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:07.397465 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:07.397941 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:07.398371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:07.399047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:07.399493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:07.399908 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:07.533148 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:07.540747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a4da4d06-a34e-40fc-a4de-ca720198077d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1511 microversion: 2.1 time: 0.154138 Aug 10 13:28:07.541615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 200/397] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:07 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:08.108480 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:08.109118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:08.115752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:08.116226 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:08.116658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:08.117374 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:08.117828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:08.118241 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:08.252819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:08.260303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d1a80b6a-d009-47da-8efc-c769f0816673 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1504 microversion: 2.1 time: 0.156514 Aug 10 13:28:08.260864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 198/398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:08 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:08.562619 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:08.563256 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:08.569837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:08.570357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:08.570785 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:08.571471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:08.571917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:08.572352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:08.704125 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:08.711700 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-526ab252-1a64-488f-829a-3a9434f89760 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1511 microversion: 2.1 time: 0.153672 Aug 10 13:28:08.719692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 201/399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:08 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:09.281616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:09.282224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:09.288833 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:09.289342 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:09.289778 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:09.290460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:09.290915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:09.291337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:09.421560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:09.428904 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-df05fc84-fb69-4eb2-a161-958f568f5c8f tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1504 microversion: 2.1 time: 0.151783 Aug 10 13:28:09.429567 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 199/400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:09 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:09.733111 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:09.733728 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:09.740514 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:09.741017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:09.741486 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:09.742163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:09.742630 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:09.743060 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:09.870307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:09.877729 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b1b43d45-bb58-4cfd-937d-743028374040 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1511 microversion: 2.1 time: 0.148630 Aug 10 13:28:09.878286 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 202/401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:09 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:10.450182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:10.450793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:10.453735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=64 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:10.459262 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:10.460291 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:10.460762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:10.461671 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:10.462789 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:10.463386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:10.669823 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:10.677993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a2511088-b8ae-49e4-ba4c-8c4d6fd1dcc9 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1504 microversion: 2.1 time: 0.231575 Aug 10 13:28:10.678572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 200/402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:10 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:10.875632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-c01ee835-92c9-43a3-8819-4757678b9cf4 req-29d9d671-c3b3-457c-838d-1c398c78a5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f314995-d604-4312-9210-5f633d99a69e", "name": "network-vif-deleted", "tag": "6624db2b-09f7-4db8-aa38-e9bcdca4f99c"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:10.886925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-c01ee835-92c9-43a3-8819-4757678b9cf4 req-29d9d671-c3b3-457c-838d-1c398c78a5c6 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:10.887696 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-c01ee835-92c9-43a3-8819-4757678b9cf4 req-29d9d671-c3b3-457c-838d-1c398c78a5c6 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:10.888296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-c01ee835-92c9-43a3-8819-4757678b9cf4 req-29d9d671-c3b3-457c-838d-1c398c78a5c6 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:10.900483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:10.901493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-c01ee835-92c9-43a3-8819-4757678b9cf4 req-29d9d671-c3b3-457c-838d-1c398c78a5c6 service nova] Creating event network-vif-deleted:6624db2b-09f7-4db8-aa38-e9bcdca4f99c for instance 6f314995-d604-4312-9210-5f633d99a69e on hv-cinder-83602 Aug 10 13:28:10.901814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:10.909524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-c01ee835-92c9-43a3-8819-4757678b9cf4 req-29d9d671-c3b3-457c-838d-1c398c78a5c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036843 Aug 10 13:28:10.914502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 203/403] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:10.924180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:10.924735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:10.932652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:10.932652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:10.932652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:10.932652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:10.975996 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-33703aed-4f38-4da1-b0f8-f620edf2fe16 req-41980073-a380-4808-a301-955ac04e3707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad705e72-944e-4b7d-bebf-7bb535c01c15", "name": "network-vif-deleted", "tag": "adcce708-4a8f-4a6c-be71-3041b69d54ec"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:10.987963 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-33703aed-4f38-4da1-b0f8-f620edf2fe16 req-41980073-a380-4808-a301-955ac04e3707 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:10.988449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-33703aed-4f38-4da1-b0f8-f620edf2fe16 req-41980073-a380-4808-a301-955ac04e3707 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:10.988883 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-33703aed-4f38-4da1-b0f8-f620edf2fe16 req-41980073-a380-4808-a301-955ac04e3707 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:11.001542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:11.004170 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-33703aed-4f38-4da1-b0f8-f620edf2fe16 req-41980073-a380-4808-a301-955ac04e3707 service nova] Creating event network-vif-deleted:adcce708-4a8f-4a6c-be71-3041b69d54ec for instance ad705e72-944e-4b7d-bebf-7bb535c01c15 on hv-cinder-83602 Aug 10 13:28:11.012380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1f6f6483-6f18-4157-94d0-2705b2153980 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1469 microversion: 2.1 time: 0.116528 Aug 10 13:28:11.018628 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-33703aed-4f38-4da1-b0f8-f620edf2fe16 req-41980073-a380-4808-a301-955ac04e3707 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041040 Aug 10 13:28:11.019149 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 201/404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:10 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1469 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:11.019249 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 204/405] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:28:11.699688 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:11.700298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:11.707918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:11.708387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:11.708813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:11.709518 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:11.709964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:11.710377 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:11.740485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:11.740945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:11.741402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:11.741836 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lazy-loading 'fault' on Instance uuid 6f314995-d604-4312-9210-5f633d99a69e {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:28:11.784555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595d22773a4d46abb87f50f4c8c058a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3398675a6c1d44089f5fb2581ada3759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:11.792037 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0ccdc529-532b-40f8-be87-efb4121c4540 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 200 len: 1304 microversion: 2.1 time: 0.096246 Aug 10 13:28:11.792600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 202/406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:11 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:12.035063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:12.035783 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:12.041832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:12.042314 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:12.042742 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:12.043422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:12.043867 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:12.044285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:12.076020 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:12.076784 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:12.077389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:12.077835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lazy-loading 'fault' on Instance uuid ad705e72-944e-4b7d-bebf-7bb535c01c15 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:28:12.119257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:12.127909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-30e6ba37-df9f-43d5-a81f-7ac5bf036e0b tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 200 len: 1306 microversion: 2.1 time: 0.098322 Aug 10 13:28:12.128459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 205/407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:12 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:12.813349 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:12.813949 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] [instance: 6f314995-d604-4312-9210-5f633d99a69e] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:12.820314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:12.820786 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:12.821255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:12.822065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:12.822511 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:12.822927 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:12.836029 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] HTTP exception thrown: Instance 6f314995-d604-4312-9210-5f633d99a69e could not be found. Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Request method failure captured: Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e HTTP/1.1 Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87Ig6sf0H5jAgMJ25KtOrkziU1hoSH754Jkw4WCWnxvri2CVjjUuKKyhi6rA-phwEa6_AEV15n9DfIWp6H6-8wNS6nFVWvpM-dC5HeHpsxUxzRfo2_gi-TSPhK952N3wt6PxB7iFPhWFydVkg89cZNRzMzQgBKyaP5L25wnyMiB9uYM Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 3398675a6c1d44089f5fb2581ada3759 Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-VolumesActionsTest-234506854 Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:28:12.837652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3398675a6c1d44089f5fb2581ada3759"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3398675a6c1d44089f5fb2581ada3759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3398675a6c1d44089f5fb2581ada3759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3398675a6c1d44089f5fb2581ada3759", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-VolumesActionsTest-234506854 Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 3398675a6c1d44089f5fb2581ada3759 Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-VolumesActionsTest-234506854 Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-VolumesActionsTest-234506854-project Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 595d22773a4d46abb87f50f4c8c058a5 Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-VolumesActionsTest-234506854-project Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 6f314995-d604-4312-9210-5f633d99a69e could not be found. Aug 10 13:28:12.839242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '6f314995-d604-4312-9210-5f633d99a69e'} Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f314995-d604-4312-9210-5f633d99a69e could not be found. Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:28:12.840164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f314995-d604-4312-9210-5f633d99a69e could not be found. Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f314995-d604-4312-9210-5f633d99a69e could not be found. Aug 10 13:28:12.841932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:12.843608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] Returning 404 to user: Instance 6f314995-d604-4312-9210-5f633d99a69e could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:28:12.843608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5b8f2b02-e53b-4417-95b8-10d2e7af6d75 tempest-VolumesActionsTest-234506854 tempest-VolumesActionsTest-234506854-project] 10.222.0.40 "GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e" status: 404 len: 111 microversion: 2.1 time: 0.030143 Aug 10 13:28:12.843608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 203/408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:12 2022] GET /compute/v2.1/servers/6f314995-d604-4312-9210-5f633d99a69e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:28:13.148925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:13.150160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: ad705e72-944e-4b7d-bebf-7bb535c01c15] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:13.157242 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:13.157733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:13.158206 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:13.159051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:13.159872 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:13.160306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:13.175251 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] HTTP exception thrown: Instance ad705e72-944e-4b7d-bebf-7bb535c01c15 could not be found. Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Request method failure captured: Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 HTTP/1.1 Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87IKOJsl6VeVWUNSjCwjHifkhRh0T4m8B5mTDDtB0VQ67BQmv2unieurWOi3Fl2LnqqK3BkDizdIlL88GqkYNNXZYCtFj5m5fJ33gvybDZPX0SowYBlWo9hnetKnFEHirTw1a2M7GRhmsdYsuKbTm4OEzSv68RGXUUZcscNCZPxQLFU Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: e43f6ad26c6a4dcdb27c9d9ba706cd0e Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1953545845 Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:28:13.176890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e43f6ad26c6a4dcdb27c9d9ba706cd0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e43f6ad26c6a4dcdb27c9d9ba706cd0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e43f6ad26c6a4dcdb27c9d9ba706cd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e43f6ad26c6a4dcdb27c9d9ba706cd0e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-VolumesSnapshotTestJSON-1953545845 Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: e43f6ad26c6a4dcdb27c9d9ba706cd0e Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1953545845 Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-VolumesSnapshotTestJSON-1953545845-project Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: d4e91c327d0c4b5dbae54cb915aca3e6 Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-VolumesSnapshotTestJSON-1953545845-project Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance ad705e72-944e-4b7d-bebf-7bb535c01c15 could not be found. Aug 10 13:28:13.178185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'ad705e72-944e-4b7d-bebf-7bb535c01c15'} Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad705e72-944e-4b7d-bebf-7bb535c01c15 could not be found. Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:28:13.178909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad705e72-944e-4b7d-bebf-7bb535c01c15 could not be found. Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad705e72-944e-4b7d-bebf-7bb535c01c15 could not be found. Aug 10 13:28:13.180900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:13.181971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Returning 404 to user: Instance ad705e72-944e-4b7d-bebf-7bb535c01c15 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:28:13.181971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b302ae9a-c31c-4696-b92e-cdfb4d9c7436 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15" status: 404 len: 111 microversion: 2.1 time: 0.033478 Aug 10 13:28:13.181971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 206/409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:13 2022] GET /compute/v2.1/servers/ad705e72-944e-4b7d-bebf-7bb535c01c15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:28:25.578416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-282475713", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "networks": [{"uuid": "ca6b999e-04cc-4062-9bfe-bb5d5838b844"}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:25.594788 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=9 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:25.596210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=50 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:25.646654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] validate_networks() for [('ca6b999e-04cc-4062-9bfe-bb5d5838b844', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:28:26.396665 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:28:26.397448 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:28:26.398295 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:28:26.398974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:28:26.399484 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:28:26.410835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:26.411304 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:26.411741 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:26.412453 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:26.412903 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:26.413353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:26.435990 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Getting quotas for project e43f6ad26c6a4dcdb27c9d9ba706cd0e. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:28:26.442320 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Getting quotas for user d4e91c327d0c4b5dbae54cb915aca3e6 and project e43f6ad26c6a4dcdb27c9d9ba706cd0e. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:28:26.455492 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:28:26.457672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:28:26.581199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a3d99d0d-2f8f-4609-9376-af098155d074 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007516 Aug 10 13:28:26.582705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 204/410] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:28:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:28:26.594368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d353def9-a427-4b46-a352-7cdaa08500eb tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:26.596359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d353def9-a427-4b46-a352-7cdaa08500eb tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:26.603511 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:26.604421 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:26.683698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d353def9-a427-4b46-a352-7cdaa08500eb tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:26.696167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d353def9-a427-4b46-a352-7cdaa08500eb tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1218 microversion: 2.1 time: 0.106519 Aug 10 13:28:26.703499 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 207/411] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:26 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:27.716447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:27.717120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:27.727347 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:27.728094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:27.728828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:27.729713 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:27.730326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:27.730814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:27.799912 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:27.812527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d55a3593-d05a-4a48-99c9-e63c8692df44 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1222 microversion: 2.1 time: 0.100526 Aug 10 13:28:27.814633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 205/412] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:27 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:28.833819 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:28.834593 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:28.847307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:28.848142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:28.848741 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:28.849658 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:28.850111 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:28.850526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:28.953684 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:28.973517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f98914cf-a2a8-4a28-9b8b-d3a5feb51d05 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1270 microversion: 2.1 time: 0.143645 Aug 10 13:28:28.974271 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 208/413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:28 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:30.001331 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:30.002531 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:30.009320 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:30.010344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:30.010974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:30.012107 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:30.012735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:30.013447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:30.291113 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:30.306458 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0692b818-b489-4385-a124-c6eae6b57468 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1318 microversion: 2.1 time: 0.310403 Aug 10 13:28:30.307037 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 206/414] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:29 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:30.854790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-7e50fe5d-ada5-4eed-8e00-4869a34e3616 req-81eaf8b4-3f09-44b3-926a-6d21a8481a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80680899-9f69-4818-994e-c2c380acb765", "tag": "2aa016be-9346-4c67-86ec-25c432ff74ae"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:30.872088 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7e50fe5d-ada5-4eed-8e00-4869a34e3616 req-81eaf8b4-3f09-44b3-926a-6d21a8481a43 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:30.873651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7e50fe5d-ada5-4eed-8e00-4869a34e3616 req-81eaf8b4-3f09-44b3-926a-6d21a8481a43 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:30.882384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7e50fe5d-ada5-4eed-8e00-4869a34e3616 req-81eaf8b4-3f09-44b3-926a-6d21a8481a43 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:30.888263 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-7e50fe5d-ada5-4eed-8e00-4869a34e3616 req-81eaf8b4-3f09-44b3-926a-6d21a8481a43 service nova] Creating event network-changed:2aa016be-9346-4c67-86ec-25c432ff74ae for instance 80680899-9f69-4818-994e-c2c380acb765 on hv-cinder-83602 Aug 10 13:28:30.895375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-7e50fe5d-ada5-4eed-8e00-4869a34e3616 req-81eaf8b4-3f09-44b3-926a-6d21a8481a43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046199 Aug 10 13:28:30.896305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 209/415] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:31.328125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:31.331394 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:31.339089 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:31.340791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:31.341973 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:31.342929 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:31.343384 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:31.343812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:31.603847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:31.613058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0392ad59-d80f-49ac-9c1a-2f88a8523bd5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1318 microversion: 2.1 time: 0.289144 Aug 10 13:28:31.613735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 207/416] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:31 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:32.636562 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:32.637470 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:32.645166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:32.645660 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:32.646123 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:32.646817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:32.647302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:32.647735 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:32.799139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:32.807990 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7d29bdcb-2dde-4742-a906-9bc980111007 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1318 microversion: 2.1 time: 0.175601 Aug 10 13:28:32.808771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 210/417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:32 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:33.830255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:33.830852 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:33.838601 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:33.839385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:33.840077 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:33.840857 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:33.842269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:33.842898 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:33.992787 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:34.001942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a604fd0d-c219-4775-bd3f-67144712386d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1318 microversion: 2.1 time: 0.176054 Aug 10 13:28:34.003611 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 208/418] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:33 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:35.023863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:35.025186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:35.033054 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:35.033838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:35.034327 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:35.035772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:35.037165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:35.038231 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:35.214055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:35.222704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d43c1e13-7db1-4261-8383-60cb66e844f6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1318 microversion: 2.1 time: 0.202811 Aug 10 13:28:35.223269 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 211/419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:35 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:35.617423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-1d765d83-19cc-4683-af74-511c5fa9ad84 req-a4ac2d87-4d71-472e-baa0-c925da0bcaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80680899-9f69-4818-994e-c2c380acb765", "name": "network-vif-plugged", "status": "completed", "tag": "2aa016be-9346-4c67-86ec-25c432ff74ae"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:35.628396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1d765d83-19cc-4683-af74-511c5fa9ad84 req-a4ac2d87-4d71-472e-baa0-c925da0bcaed service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:35.628793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1d765d83-19cc-4683-af74-511c5fa9ad84 req-a4ac2d87-4d71-472e-baa0-c925da0bcaed service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:35.629244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1d765d83-19cc-4683-af74-511c5fa9ad84 req-a4ac2d87-4d71-472e-baa0-c925da0bcaed service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:35.642200 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-1d765d83-19cc-4683-af74-511c5fa9ad84 req-a4ac2d87-4d71-472e-baa0-c925da0bcaed service nova] Creating event network-vif-plugged:2aa016be-9346-4c67-86ec-25c432ff74ae for instance 80680899-9f69-4818-994e-c2c380acb765 on hv-cinder-83602 Aug 10 13:28:35.650020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-1d765d83-19cc-4683-af74-511c5fa9ad84 req-a4ac2d87-4d71-472e-baa0-c925da0bcaed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033499 Aug 10 13:28:35.650020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 209/420] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:36.244107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:36.245347 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:36.255842 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:36.256660 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:36.257281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:36.258141 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:36.258758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:36.259182 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:36.407196 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:36.415569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e9b2d219-5d5e-4f16-b6a8-3715ce76edd6 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1318 microversion: 2.1 time: 0.175554 Aug 10 13:28:36.416158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 212/421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:36 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:37.434509 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:37.436509 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:37.440488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:37.441212 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:37.447165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:37.447648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:37.448086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:37.448763 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:37.449255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:37.449688 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:37.580047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:37.587426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-db608d38-6710-4f8e-bde0-04402c8c68d0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1318 microversion: 2.1 time: 0.153883 Aug 10 13:28:37.587986 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 210/422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:37 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:38.607977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:38.608577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:38.610866 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:38.617114 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:38.617589 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:38.618172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:38.618862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:38.619311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:38.619864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:38.766948 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:38.774500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-26cf35ba-6003-46b9-afed-dd1923573488 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1508 microversion: 2.1 time: 0.170750 Aug 10 13:28:38.775326 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 213/423] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:38 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:38.795018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41e51183-9094-4f85-b211-500ce40a0064", "device": "/dev/sdb"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:38.797450 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:38.803743 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:38.804221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:38.810736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:38.810736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:38.810736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:38.810736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:39.576711 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-be7daa19-8013-48a6-ae96-6aebf5d4596d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "POST /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785312 Aug 10 13:28:39.577358 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 211/424] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:28:38 2022] POST /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:47.691502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:47.692021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:47.699198 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.699564 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.700001 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.701429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.702080 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.702661 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.730526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-09e02188-88d4-45d0-975f-46b3335dc32c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b/ips" status: 200 len: 150 microversion: 2.1 time: 0.043396 Aug 10 13:28:47.735348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 214/425] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:28:47 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:47.744604 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1ffd9b4-a05d-4a08-96a5-a76114e953fe"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:47.747801 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:47.756193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.756805 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.757359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.758186 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.758750 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.759405 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.863762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Invalid volume: volume b1ffd9b4-a05d-4a08-96a5-a76114e953fe is already attached to instances: 632d02cd-2985-4976-944b-0a5c9acf06c6 Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: POST /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b/os-volume_attachments HTTP/1.1 Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 74 Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:28:47.867105 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {"volumeAttachment": {"volumeId": "b1ffd9b4-a05d-4a08-96a5-a76114e953fe"}} Aug 10 13:28:47.868680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Invalid volume: volume b1ffd9b4-a05d-4a08-96a5-a76114e953fe is already attached to instances: 632d02cd-2985-4976-944b-0a5c9acf06c6 Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'server_id': '2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b', 'body': {'volumeAttachment': {'volumeId': 'b1ffd9b4-a05d-4a08-96a5-a76114e953fe'}}} Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b1ffd9b4-a05d-4a08-96a5-a76114e953fe is already attached to instances: 632d02cd-2985-4976-944b-0a5c9acf06c6 Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:47.869534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b1ffd9b4-a05d-4a08-96a5-a76114e953fe is already attached to instances: 632d02cd-2985-4976-944b-0a5c9acf06c6 Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:47.870667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:28:47.873617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:28:47.873617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:28:47.873617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:28:47.873617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b1ffd9b4-a05d-4a08-96a5-a76114e953fe is already attached to instances: 632d02cd-2985-4976-944b-0a5c9acf06c6 Aug 10 13:28:47.873617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:28:47.873617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 400 to user: Invalid volume: volume b1ffd9b4-a05d-4a08-96a5-a76114e953fe is already attached to instances: 632d02cd-2985-4976-944b-0a5c9acf06c6 {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:28:47.873617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ac05c57b-cb18-4ba5-a4da-58de9774b990 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128431 Aug 10 13:28:47.873617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 212/426] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:28:47 2022] POST /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:28:47.878806 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:47.879470 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:47.887436 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.888122 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.888745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.889526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.889984 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.890423 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.921137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:28:48.195603 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1422f220-4a81-4c7a-a563-370e88c89335 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 204 len: 0 microversion: 2.1 time: 0.320745 Aug 10 13:28:48.196276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 215/427] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:28:47 2022] DELETE /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:28:48.208431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:48.209082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:48.217904 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:48.218687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:48.219150 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:48.220097 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:48.220554 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:48.220981 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:48.366685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:48.374535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:48.374535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:48.378695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e7b45ef2-0237-46fd-9d5f-ffff2e4c940d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1681 microversion: 2.1 time: 0.177954 Aug 10 13:28:48.393261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:48.393261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:48.393261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:48.393261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:48.393639 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:48.393639 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:48.394175 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 213/428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:48 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:48.414005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-744cccd7-eb3c-48f2-b79b-29e31c177714 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/ips" status: 200 len: 153 microversion: 2.20 time: 0.046314 Aug 10 13:28:48.414632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 216/429] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Aug 10 13:28:48 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:28:49.227679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:28:49.227679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:28:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:28:49.402341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:49.402982 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:49.410476 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:49.410960 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:49.411394 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:49.412190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:49.412531 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:49.412954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:49.561391 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:49.573835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-425dbc3d-d4d3-462f-8893-b103189e4ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1681 microversion: 2.1 time: 0.173032 Aug 10 13:28:49.573835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 214/430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:49 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:50.594834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:50.595451 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:50.602444 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:50.602934 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:50.603362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:50.606016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:50.606666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:50.607236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:50.874062 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:50.882367 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f75f659a-a0f6-40cc-8a9b-cc5504bba623 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1681 microversion: 2.1 time: 0.292041 Aug 10 13:28:50.883138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 217/431] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:50 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1681 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:51.790429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:51.790972 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:51.803385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:51.803933 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:51.804388 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:51.808297 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:51.809160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:51.810134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:51.872852 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'flavor' on Instance uuid e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:28:51.904115 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:51.906001 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:51.912412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:51.913493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:51.914140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:51.915068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:51.915773 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:51.916542 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:52.131460 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:52.159365 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5eebbe45-506e-4cdf-9f90-8062c4f61ddf tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1681 microversion: 2.1 time: 0.259122 Aug 10 13:28:52.161094 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 218/432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:51 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:52.379096 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-03690463-194d-4e11-8696-c7db92151b65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/action" status: 202 len: 0 microversion: 2.20 time: 0.592588 Aug 10 13:28:52.383250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 215/433] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Aug 10 13:28:51 2022] POST /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:28:52.389238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:52.389847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:52.396370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:52.396969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:52.397532 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:52.399000 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:52.399759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:52.400680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:52.578139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:52.586793 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:52.588320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:52.589542 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fbf4d36c-21fa-4110-bc34-81c5781cdb1f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.205053 Aug 10 13:28:52.590104 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 219/434] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:28:52 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:28:53.183705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:53.185212 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:53.195153 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:53.196307 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:53.196856 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:53.198028 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:53.198860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:53.199395 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:53.612973 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:53.613606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:53.620778 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:53.621582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:53.622607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:53.623840 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:53.624650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:53.625524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:53.656107 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:53.674268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4def3f41-4607-4776-8ee7-b3b6cb595d29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1681 microversion: 2.1 time: 0.494930 Aug 10 13:28:53.674268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 216/435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:53 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1681 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:53.834035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:53.843902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:53.845457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:53.846659 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a82ef68d-abd8-49fc-8650-66a3925f0224 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.237569 Aug 10 13:28:53.851743 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 220/436] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:28:53 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:28:54.305769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-b338a343-2d90-44b2-a833-0d744c9fc6c4 req-ecfaed42-5744-4507-8fd5-78ae28328153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b", "name": "network-vif-deleted", "tag": "44b3fb3b-e0d3-4232-9bd8-9e71e32368f8"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:54.320937 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b338a343-2d90-44b2-a833-0d744c9fc6c4 req-ecfaed42-5744-4507-8fd5-78ae28328153 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.321511 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b338a343-2d90-44b2-a833-0d744c9fc6c4 req-ecfaed42-5744-4507-8fd5-78ae28328153 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.321949 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b338a343-2d90-44b2-a833-0d744c9fc6c4 req-ecfaed42-5744-4507-8fd5-78ae28328153 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.355305 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-b338a343-2d90-44b2-a833-0d744c9fc6c4 req-ecfaed42-5744-4507-8fd5-78ae28328153 service nova] Creating event network-vif-deleted:44b3fb3b-e0d3-4232-9bd8-9e71e32368f8 for instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b on hv-cinder-83602 Aug 10 13:28:54.363549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-b338a343-2d90-44b2-a833-0d744c9fc6c4 req-ecfaed42-5744-4507-8fd5-78ae28328153 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062202 Aug 10 13:28:54.365324 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 217/437] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:54.465445 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8b935f4-bdc8-4a66-b020-e3cd2fc0e92a"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:54.469292 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:54.476183 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.476850 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.477458 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.478427 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.479120 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.479762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.698162 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:54.703098 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:54.709185 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.710035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.710696 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.711643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.712316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.712962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.812717 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:54.825027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f261817e-262b-42cd-a1e9-a2a5ee902777 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1614 microversion: 2.1 time: 0.132412 Aug 10 13:28:54.826007 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 218/438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:54 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:54.879532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:54.880547 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:54.895210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.896127 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.896871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.898077 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.899565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.902220 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.925365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:55.151496 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:55.186139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:55.193860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:55.196625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-98e2c0c6-8c7b-4a8d-a0ae-d54d5c81c52c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.322651 Aug 10 13:28:55.197480 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 219/439] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:28:54 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:28:55.846485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:55.847257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:55.849845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:55.856199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:55.860032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:55.860032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:55.860032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:55.860032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:55.860596 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:55.933597 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:55.936825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:55.937436 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:55.938616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lazy-loading 'fault' on Instance uuid 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:28:56.037447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:56.048140 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a775b2c5-62eb-496d-91e9-9fcbef1cf9f5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 200 len: 1331 microversion: 2.1 time: 0.205902 Aug 10 13:28:56.049075 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 220/440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:55 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 1331 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:56.176156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3a6186e9-a59e-4858-8464-441ceb3b0096 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.712365 Aug 10 13:28:56.176156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 221/441] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:28:54 2022] POST /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments => generated 194 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:56.231098 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:56.232614 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:56.247226 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:56.247915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:56.249104 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:56.249859 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:56.250327 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:56.250760 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:56.507757 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:56.519602 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:56.525091 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:56.532332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5a85c692-ceec-4650-91d2-4a26a8dd4564 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.303912 Aug 10 13:28:56.534389 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 221/442] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:28:56 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:28:57.073099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:57.074194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:57.085333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:57.090533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:57.090533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:57.090533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:57.090533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:57.091119 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:57.105349 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b HTTP/1.1 Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:28:57.108471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:28:57.109964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b'} Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:28:57.110711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:28:57.111952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:28:57.114688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:28:57.114688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-71170c0f-ddac-4d6d-aee2-8cc90ecb7a76 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 404 len: 111 microversion: 2.1 time: 0.042083 Aug 10 13:28:57.114688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 222/443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:57 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:28:57.119224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5118c4aa-9b8b-4a28-a765-db670753fd75 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '.version_select at 0x7ff6a8293ee0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:57.233210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5118c4aa-9b8b-4a28-a765-db670753fd75 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819910416" status: 202 len: 0 microversion: 2.1 time: 0.117513 Aug 10 13:28:57.234819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 222/444] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Aug 10 13:28:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819910416 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:28:57.558107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:57.559190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:57.571214 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:57.571957 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:57.572560 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:57.573475 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:57.577249 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:57.582213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:57.615305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:57.994293 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:58.001954 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:58.003845 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:58.008757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-536edd88-1e86-4eed-9084-171249fe76bf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.454570 Aug 10 13:28:58.010506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 223/445] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:28:57 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:28:58.479649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:58.480385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:58.492582 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:58.493786 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:58.495062 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:58.496081 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:58.496826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:58.497577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:58.586200 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lazy-loading 'services' on Instance uuid 632d02cd-2985-4976-944b-0a5c9acf06c6 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:28:58.801663 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8a8976dd-f1fd-4126-9522-d9d05d0e3a7b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments/b1ffd9b4-a05d-4a08-96a5-a76114e953fe" status: 202 len: 0 microversion: 2.1 time: 0.326496 Aug 10 13:28:58.807237 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 223/446] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:28:58 2022] DELETE /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments/b1ffd9b4-a05d-4a08-96a5-a76114e953fe => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:28:58.814035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:58.818669 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:58.834593 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:58.835724 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:58.835724 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:58.836214 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:58.836666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:58.837138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:58.880354 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-bd1b08b7-08e0-4341-8dbb-9dbfb71be82d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073133 Aug 10 13:28:58.881542 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 224/447] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:28:58 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:59.041234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:59.043027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:59.050791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:59.051655 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:59.052392 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:59.053359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:59.054205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:59.054856 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:59.233781 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:59.248260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:59.250086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:59.251269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3e1ac9ba-5350-4984-9090-8daf87a491f6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.215145 Aug 10 13:28:59.251839 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 224/448] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:28:59 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:28:59.893840 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:59.896041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:59.900416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:59.904704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:59.905359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:59.905791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:59.906487 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:59.906937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:59.907356 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:59.945966 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6f2c53d2-a9f2-497d-94b5-658cd25da036 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056031 Aug 10 13:28:59.946538 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 225/449] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:28:59 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:00.249351 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:00.249990 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:00.256911 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:00.257452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:00.258031 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:00.258737 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:00.259188 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:00.259609 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:00.275851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:00.276717 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:00.287327 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:00.288230 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:00.288823 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:00.289702 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:00.290303 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:00.290872 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:00.367377 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lazy-loading 'services' on Instance uuid 80680899-9f69-4818-994e-c2c380acb765 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:29:00.472702 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:00.481369 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:00.483405 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:00.484698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-514b0087-06e6-424a-a57c-70a86bebc007 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.213955 Aug 10 13:29:00.485602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 226/450] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:00 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:00.613647 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fdfe6ceb-5ff9-4f70-8836-3fd4ff06a742 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "DELETE /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765/os-volume_attachments/41e51183-9094-4f85-b211-500ce40a0064" status: 202 len: 0 microversion: 2.1 time: 0.372502 Aug 10 13:29:00.618346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 225/451] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:29:00 2022] DELETE /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765/os-volume_attachments/41e51183-9094-4f85-b211-500ce40a0064 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:29:00.960149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:00.962615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:00.970717 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:00.971564 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:00.972249 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:00.973293 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:00.973951 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:00.974541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:01.008658 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-41d2f615-8ce1-4df5-9f03-e82593732b32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053266 Aug 10 13:29:01.009300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 227/452] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:29:00 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:01.508502 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:01.509359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:01.519202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:01.519962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:01.520667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:01.521640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:01.522242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:01.522704 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:01.689312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:01.697978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:01.699902 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:01.701428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c34b0aec-7b45-4526-a9cc-bf71f0dca165 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.197429 Aug 10 13:29:01.702290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 226/453] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:01 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:02.021314 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:02.024253 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:02.032862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:02.033616 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:02.034216 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:02.035176 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:02.035623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:02.036043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:02.051580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:02.052223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:02.058893 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:02.060768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:02.061421 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:02.062651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:02.063284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:02.064006 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:02.078287 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9ee12977-464b-406d-9bdc-69b81b60e4a3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060997 Aug 10 13:29:02.082635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 228/454] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:29:02 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:02.177542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lazy-loading 'services' on Instance uuid 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:29:02.333544 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-85d96796-5838-4433-ac3a-c6a7147d3c42 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/os-volume_attachments/5d7610e8-519e-4e21-a7c1-db2ea3b78277" status: 202 len: 0 microversion: 2.1 time: 0.286253 Aug 10 13:29:02.334542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 227/455] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:29:02 2022] DELETE /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/os-volume_attachments/5d7610e8-519e-4e21-a7c1-db2ea3b78277 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:29:02.724460 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:02.725394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:02.732378 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:02.732900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:02.733392 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:02.734086 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:02.734541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:02.734969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:02.879876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:02.888899 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:02.890463 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:02.891634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b22f9306-62a3-4a3a-8d01-dd12d00acee7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.171413 Aug 10 13:29:02.892195 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 229/456] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:02 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:03.091078 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:03.093435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:03.100001 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:03.100489 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:03.100923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:03.110159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:03.110159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:03.110159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:03.132950 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f197e1e3-d867-4ce8-a085-65a88e41b462 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Aug 10 13:29:03.133542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 228/457] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:29:03 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:03.919939 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:03.920622 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:03.945086 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:03.945582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:03.946016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:03.946723 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:03.947178 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:03.947602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:04.096576 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:04.104687 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:04.106358 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:04.107847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2292ebf9-0d44-4298-a36e-848a47a3a011 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.196340 Aug 10 13:29:04.108401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 230/458] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:03 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:04.147733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:04.150478 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:04.157931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:04.158410 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:04.158842 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:04.159522 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:04.160386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:04.160962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:04.195340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-eb6689b1-de30-418f-9977-f3576d3d41f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053881 Aug 10 13:29:04.196202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 229/459] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:29:04 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:04.995270 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:04.998351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:05.005065 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.005891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.006139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.006820 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.007279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.007700 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.035407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lazy-loading 'flavor' on Instance uuid e0788538-19b6-4d2b-ab3f-521dbd8cc729 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:29:05.133049 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:05.133735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:05.142283 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.142861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.143364 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.144149 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.144673 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.145224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.302378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:05.319418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:05.327537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:05.330152 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9d29812c-5590-4110-b677-e3367884dd06 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.200880 Aug 10 13:29:05.331053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 230/460] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:05 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:05.335917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:05.338235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:05.346267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.346969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.347560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.348403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.348863 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.349321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.383309 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6098aac0-e860-4a90-85fb-fefd55cff498 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050964 Aug 10 13:29:05.383881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 231/461] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:29:05 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:29:05.452182 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2959b9b2-f827-4578-9777-47a77c02e4a8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/action" status: 200 len: 32 microversion: 2.1 time: 0.460641 Aug 10 13:29:05.453862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 231/462] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:29:04 2022] POST /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/action => generated 32 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:29:05.462717 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:05.463215 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:05.464566 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:05.465614 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:05.469609 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.470330 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.470927 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.471802 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.472412 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.473008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.475997 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.476559 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.477115 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.477935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.482526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.482526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.506619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:29:05.680474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:05.730854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:05.740488 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-751fdbc9-01b0-4329-a427-5b626c51d056 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.281127 Aug 10 13:29:05.741997 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 232/463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:05 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:05.904868 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1a87c55c-90ad-443e-b089-bb23a9956e7a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 204 len: 0 microversion: 2.1 time: 0.445637 Aug 10 13:29:05.905542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 232/464] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:29:05 2022] DELETE /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:29:05.916478 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:05.917136 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:05.924641 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.928328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.928328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:05.928328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:05.928328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:05.928691 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.059757 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:06.060469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:06.069240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:06.069968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:06.070736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.072414 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:06.072414 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:06.072663 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.092314 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:06.100056 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6af49d4f-e1ba-4645-a228-7937ce3ced64 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1682 microversion: 2.1 time: 0.187547 Aug 10 13:29:06.128096 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 233/465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:05 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:06.128272 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:29:06.357243 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:06.357842 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:06.363686 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:06.364161 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:06.364588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.365297 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:06.365744 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:06.366159 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.503481 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:06.511440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:06.512959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:06.514286 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ef868af9-0266-42cc-8063-62c87397560b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.161587 Aug 10 13:29:06.514678 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 234/466] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:06 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:06.670469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1da185e1-36b9-48c5-9acf-01668a3393d8 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "DELETE /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 204 len: 0 microversion: 2.1 time: 0.617136 Aug 10 13:29:06.671271 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 233/467] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:29:06 2022] DELETE /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:29:06.679576 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:06.680292 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:06.687415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:06.687966 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:06.688472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.689269 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:06.689862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:06.690309 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.768867 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:06.770115 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:06.791214 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:06.791756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:06.792200 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.792917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:06.793399 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:06.794230 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:06.867461 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:06.877937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-19289e42-106d-4fce-a435-ee1e4c5826c5 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1514 microversion: 2.1 time: 0.202382 Aug 10 13:29:06.884917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 235/468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:06 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:06.971354 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:06.979635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8868a4f1-e67d-48fe-a623-dc73d1f0e285 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.217732 Aug 10 13:29:06.990476 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 234/469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:06 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:07.150764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:07.161069 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:07.167829 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:07.168312 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:07.168747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:07.170074 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:07.170536 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:07.170959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:07.313579 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:07.321037 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9bff2698-9b95-4b69-800d-c897774a24ae tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1682 microversion: 2.1 time: 0.174643 Aug 10 13:29:07.321602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 236/470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:07 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:07.537454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:07.538088 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:07.545164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:07.545653 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:07.546084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:07.546772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:07.547281 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:07.547711 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:07.617609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-307f0653-2292-4f47-a63e-478ccb3854f9 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Action: 'create', calling method: .version_select at 0x7ff6a8460160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-626095839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaJeptWVY6lx2ZYVfjvj7p6nV+6vdMBuq03uD006G1Une9sTe9sAxkJqEFHt417IdbWaQLOsCz37U0n54YNjmkyrznyUtFU5c5aB/WGpQl2gba31nNnbke1snnSb7h71w=="}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:07.636521 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-307f0653-2292-4f47-a63e-478ccb3854f9 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Getting quotas for project 6ccc46e1ccb04fb386367a71ad13f008. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:29:07.642751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-307f0653-2292-4f47-a63e-478ccb3854f9 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Getting quotas for user 379f81ea933d4207865a8d1f299b5634 and project 6ccc46e1ccb04fb386367a71ad13f008. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:29:07.721371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:07.723963 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-307f0653-2292-4f47-a63e-478ccb3854f9 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.111660 Aug 10 13:29:07.725192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 237/471] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:29:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:29:07.732118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:07.733669 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:07.734985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7eb3a255-8ee8-4bb8-99fb-e938fe8239a0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.201609 Aug 10 13:29:07.741272 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 235/472] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:07 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:07.775897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-913597801", "imageRef": "c7b045de-67a7-4a2f-ad7b-6b6cf629752d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-626095839", "networks": [{"uuid": "6ff40e56-023c-4468-b950-aa06a8a091a8"}]}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:07.835685 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.network.neutron [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] validate_networks() for [('6ff40e56-023c-4468-b950-aa06a8a091a8', None, None, None, None, None)] {{(pid=118003) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:29:07.905811 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:07.906337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:07.912730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:07.913252 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:07.913689 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:07.914402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:07.914854 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:07.915276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.053232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:08.061729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6c3cf4b8-7517-4d03-b992-15db8447b22c tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1514 microversion: 2.1 time: 0.159878 Aug 10 13:29:08.062419 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 236/473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:07 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:08.080240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:08.080844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:08.086794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:08.087282 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:08.087720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.088409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:08.088862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:08.089339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.226406 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:08.234632 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2a5dad25-7ff5-43ab-9fa7-dcfc72d6cb8e tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.158253 Aug 10 13:29:08.235196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 237/474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:08 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:08.343537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:08.344183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:08.350197 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:08.350675 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:08.351112 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.351799 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:08.352249 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:08.352674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.451616 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Flavor limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:29:08.452123 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Image limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:29:08.452498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Flavor pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:29:08.452904 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Image pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:29:08.453336 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:29:08.462830 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:08.463611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:08.463723 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.464434 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:08.464913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:08.467834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.486429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Getting quotas for project 6ccc46e1ccb04fb386367a71ad13f008. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:29:08.490430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Getting quotas for user 379f81ea933d4207865a8d1f299b5634 and project 6ccc46e1ccb04fb386367a71ad13f008. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:29:08.502053 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Going to run 1 instances... {{(pid=118003) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:29:08.504226 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b045de-67a7-4a2f-ad7b-6b6cf629752d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:29:08.507476 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:08.515525 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-01241992-8826-483f-8150-4dbcede02b33 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1682 microversion: 2.1 time: 0.176737 Aug 10 13:29:08.516094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 238/475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:08 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:08.631266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-881985c1-5e4d-47a4-a5fd-3028b933b889 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859190 Aug 10 13:29:08.631901 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 238/476] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:29:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:29:08.643692 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-de4dc660-d65c-4eaa-afe2-e50943a2d54f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:08.644305 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-de4dc660-d65c-4eaa-afe2-e50943a2d54f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:08.703551 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-de4dc660-d65c-4eaa-afe2-e50943a2d54f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:08.710128 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-de4dc660-d65c-4eaa-afe2-e50943a2d54f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1257 microversion: 2.1 time: 0.070348 Aug 10 13:29:08.710697 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 239/477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:08 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:08.758135 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:08.758750 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:08.766018 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:08.766516 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:08.767063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.767637 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:08.768092 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:08.768569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:08.908785 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:08.912543 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:08.917243 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:08.919913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:08.921106 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-07b0253f-8a19-4588-9dbf-faa6742ed331 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.166961 Aug 10 13:29:08.921661 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 239/478] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:08 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:09.083300 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:09.083909 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:09.094573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.097242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.097242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.097767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.098817 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.098817 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.237458 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:09.245644 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1f2ecdf7-ebdf-41c1-8f37-98e3696319a0 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1514 microversion: 2.1 time: 0.166255 Aug 10 13:29:09.246356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 240/479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:09 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:09.256712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:09.257850 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:09.267367 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.267878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.268323 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.269145 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.269611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.270048 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.402535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:09.410825 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0870b5b0-ec03-40fb-a9fd-f9bdacf5ec54 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.158711 Aug 10 13:29:09.411405 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 240/480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:09 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:09.537770 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:09.538382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:09.544447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.544929 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.547365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.550348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.550348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.550348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.701995 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:09.709944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-968f2494-96a7-4b9f-ad19-6585f993ba4d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1682 microversion: 2.1 time: 0.176213 Aug 10 13:29:09.710514 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 241/481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:09 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:09.731788 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:09.732365 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:09.745888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.746382 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.747626 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.748345 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.748804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.749268 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.900620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:09.908553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d84f1c58-0559-4cc3-aae4-6b53fe7241c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1261 microversion: 2.1 time: 0.182572 Aug 10 13:29:09.910331 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 241/482] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:09 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:09.932052 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4c49068e-bbe7-45fd-820b-2da4c69b4470 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:09.940306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4c49068e-bbe7-45fd-820b-2da4c69b4470 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.940806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4c49068e-bbe7-45fd-820b-2da4c69b4470 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.941301 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4c49068e-bbe7-45fd-820b-2da4c69b4470 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.946788 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:09.948379 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:09.957736 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.963139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.963139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.963139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:09.963139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:09.963581 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:09.983948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4c49068e-bbe7-45fd-820b-2da4c69b4470 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Going to try to stop instance {{(pid=118002) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 13:29:10.188618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4c49068e-bbe7-45fd-820b-2da4c69b4470 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/action" status: 202 len: 0 microversion: 2.1 time: 0.260604 Aug 10 13:29:10.190025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 242/483] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:29:09 2022] POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:29:10.206806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:10.207494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:10.220381 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.220878 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.221355 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.222047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.222495 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.222915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.320795 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:10.332351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:10.334055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:10.335366 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-076c564a-66d9-4d2e-99da-aa8e6689416b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1745 microversion: 2.20 time: 0.395590 Aug 10 13:29:10.336039 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 242/484] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:09 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1745 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:10.341580 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:10.342481 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:10.348464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.349295 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.349947 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.350881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.351476 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.352003 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.403502 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:10.412588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-48e9d221-51c2-4057-877a-6bf2c3d233fa tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.209831 Aug 10 13:29:10.420292 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 243/485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:10 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:10.432743 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:10.433455 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:10.440247 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.440729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.441192 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.441879 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.442328 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.442746 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.592125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:10.607452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9813dc25-6df1-4222-8a8f-0384425e095a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.171263 Aug 10 13:29:10.607452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 244/486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:10 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:10.629513 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:10.637468 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ac3e4443-c505-4ca6-8d61-ea99a96f8729 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1514 microversion: 2.1 time: 0.299923 Aug 10 13:29:10.638057 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 243/487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:10 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:10.731584 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:10.732208 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:10.738689 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.739173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.739609 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.740301 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.740757 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.741221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.808146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:10.818487 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-08929485-2401-4de0-808f-c065dc40382b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1615 microversion: 2.1 time: 0.091020 Aug 10 13:29:10.819071 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 245/488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:10 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:10.930669 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:10.933240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:10.939397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.940180 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.940845 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:10.941796 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:10.942458 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:10.943092 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.002919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-b6fa4ed9-dfbd-40f4-b244-ea02fb264856 req-4df86b57-b1ef-445a-8222-7317b117e3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80680899-9f69-4818-994e-c2c380acb765", "name": "network-vif-deleted", "tag": "2aa016be-9346-4c67-86ec-25c432ff74ae"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:11.017148 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b6fa4ed9-dfbd-40f4-b244-ea02fb264856 req-4df86b57-b1ef-445a-8222-7317b117e3f6 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.018194 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b6fa4ed9-dfbd-40f4-b244-ea02fb264856 req-4df86b57-b1ef-445a-8222-7317b117e3f6 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.018941 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b6fa4ed9-dfbd-40f4-b244-ea02fb264856 req-4df86b57-b1ef-445a-8222-7317b117e3f6 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.040489 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-b6fa4ed9-dfbd-40f4-b244-ea02fb264856 req-4df86b57-b1ef-445a-8222-7317b117e3f6 service nova] Creating event network-vif-deleted:2aa016be-9346-4c67-86ec-25c432ff74ae for instance 80680899-9f69-4818-994e-c2c380acb765 on hv-cinder-83602 Aug 10 13:29:11.048241 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-b6fa4ed9-dfbd-40f4-b244-ea02fb264856 req-4df86b57-b1ef-445a-8222-7317b117e3f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052048 Aug 10 13:29:11.051619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 246/489] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:29:11.081036 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:11.097569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-350add28-c5e9-486c-a309-69f271f6e9ab tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1309 microversion: 2.1 time: 0.170608 Aug 10 13:29:11.099012 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 244/490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:10 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:11.365341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:11.366051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:11.372644 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.373160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.373600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.374307 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.374762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.375237 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.435756 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:11.436443 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:11.449284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.451617 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.452066 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.452796 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.453284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.454148 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.564227 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:11.589967 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:11.596778 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:11.598270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-98514e71-83bd-4bf0-ba01-da4c565c182c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1745 microversion: 2.20 time: 0.238456 Aug 10 13:29:11.598847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 247/491] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:11 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:11.627431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:11.628296 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:11.638383 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.639137 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.639902 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.640938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.641568 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.642152 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.676308 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:11.822371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:11.833696 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-623a00b5-b6b6-438a-b163-825f774007d5 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.210598 Aug 10 13:29:11.853996 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 248/492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:11 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:11.854575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:11.864363 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:11.865883 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:11.866698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-feae40e2-52d4-472c-a52d-1b9484cb6cf7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.435358 Aug 10 13:29:11.879724 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 245/493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:11 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:11.884477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:11.891039 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:11.899921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.900614 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.901547 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.902442 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.903385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.905600 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.905972 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.906156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.906689 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.907506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.908089 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.908738 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.977379 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.977973 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.979213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.981014 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lazy-loading 'fault' on Instance uuid 80680899-9f69-4818-994e-c2c380acb765 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:29:11.984968 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:11.989404 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:11.991454 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:11.992167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lazy-loading 'fault' on Instance uuid 632d02cd-2985-4976-944b-0a5c9acf06c6 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:29:12.048377 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e91c327d0c4b5dbae54cb915aca3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f6ad26c6a4dcdb27c9d9ba706cd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:12.056524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-879e7865-8305-45cd-9c89-6014c25db6d4 tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 200 len: 1308 microversion: 2.1 time: 0.200730 Aug 10 13:29:12.058176 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 249/494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:11 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:12.120533 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:12.121671 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:12.129506 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:12.130577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:12.131270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:12.132459 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:12.133206 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:12.133924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:12.220469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:12.246263 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0dee4a4d-fb41-4bde-9798-324fbc52f631 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1315 microversion: 2.1 time: 0.129833 Aug 10 13:29:12.258563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 250/495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:12 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:12.309625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:12.319150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-825b737b-a215-4414-95a9-047feb6ebb20 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 200 len: 1332 microversion: 2.1 time: 0.444546 Aug 10 13:29:12.336167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 246/496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:11 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 1332 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:12.624615 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:12.625449 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:12.642413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:12.645285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:12.645285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:12.645285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:12.656726 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:12.658790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:12.861446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:12.862281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:12.876295 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:12.877019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:12.878473 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:12.890162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:12.890843 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:12.891299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:12.954864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:12.967420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:12.969038 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:12.970323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-781ff584-4391-4489-b555-4f0b40d436c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.351618 Aug 10 13:29:12.972359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 251/497] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:12 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:12.978610 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:12.979448 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:12.987773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:12.988654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:12.989846 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:12.990756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:12.991450 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:12.992187 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:13.208193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:13.217398 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-071a7d96-9a3b-47f1-a118-952aa56cb945 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.243355 Aug 10 13:29:13.219139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 252/498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:12 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:13.226258 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:13.227139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] [instance: 80680899-9f69-4818-994e-c2c380acb765] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:13.235377 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:13.236354 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:13.236962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:13.238316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:13.239512 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:13.240577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:13.278221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] HTTP exception thrown: Instance 80680899-9f69-4818-994e-c2c380acb765 could not be found. Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Request method failure captured: Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 HTTP/1.1 Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87IKOJsl6VeVWUNSjCwjHifkhRh0T4m8B5mTDDtB0VQ67BQmv2unieurWOi3Fl2LnqqK3BkDizdIlL88GqkYNNXZYCtFj5m5fJ33gvybDZPX0SowYBlWo9hnetKnFEHirTw1a2M7GRhmsdYsuKbTm4OEzSv68RGXUUZcscNCZPxQLFU Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: e43f6ad26c6a4dcdb27c9d9ba706cd0e Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1953545845 Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:29:13.280376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e43f6ad26c6a4dcdb27c9d9ba706cd0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e43f6ad26c6a4dcdb27c9d9ba706cd0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e43f6ad26c6a4dcdb27c9d9ba706cd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e43f6ad26c6a4dcdb27c9d9ba706cd0e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-VolumesSnapshotTestJSON-1953545845 Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: e43f6ad26c6a4dcdb27c9d9ba706cd0e Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1953545845 Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-VolumesSnapshotTestJSON-1953545845-project Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: d4e91c327d0c4b5dbae54cb915aca3e6 Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-VolumesSnapshotTestJSON-1953545845-project Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 80680899-9f69-4818-994e-c2c380acb765 could not be found. Aug 10 13:29:13.286023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '80680899-9f69-4818-994e-c2c380acb765'} Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80680899-9f69-4818-994e-c2c380acb765 could not be found. Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:29:13.297378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80680899-9f69-4818-994e-c2c380acb765 could not be found. Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80680899-9f69-4818-994e-c2c380acb765 could not be found. Aug 10 13:29:13.299370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.301070 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] Returning 404 to user: Instance 80680899-9f69-4818-994e-c2c380acb765 could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:29:13.301070 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dd060ec3-d49d-4277-b46a-271572b48f4d tempest-VolumesSnapshotTestJSON-1953545845 tempest-VolumesSnapshotTestJSON-1953545845-project] 10.222.0.40 "GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765" status: 404 len: 111 microversion: 2.1 time: 0.062966 Aug 10 13:29:13.301070 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 253/499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:13 2022] GET /compute/v2.1/servers/80680899-9f69-4818-994e-c2c380acb765 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:29:13.301486 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:13.305506 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-cb26cacd-f3b7-4158-a927-9f6b9c6bbaa5 req-ffeed68a-971b-4cf3-be17-57d5af04b8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632d02cd-2985-4976-944b-0a5c9acf06c6", "name": "network-vif-deleted", "tag": "0c6cfffc-b3b5-4dd3-8de0-efb030b38e70"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:13.313059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1eaa4778-08ba-43aa-96bd-13411ca894f7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.458709 Aug 10 13:29:13.313059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 247/500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:12 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:13.342677 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cb26cacd-f3b7-4158-a927-9f6b9c6bbaa5 req-ffeed68a-971b-4cf3-be17-57d5af04b8a1 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:13.343165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cb26cacd-f3b7-4158-a927-9f6b9c6bbaa5 req-ffeed68a-971b-4cf3-be17-57d5af04b8a1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:13.347019 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cb26cacd-f3b7-4158-a927-9f6b9c6bbaa5 req-ffeed68a-971b-4cf3-be17-57d5af04b8a1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:13.351415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:13.354416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:13.382421 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-cb26cacd-f3b7-4158-a927-9f6b9c6bbaa5 req-ffeed68a-971b-4cf3-be17-57d5af04b8a1 service nova] Creating event network-vif-deleted:0c6cfffc-b3b5-4dd3-8de0-efb030b38e70 for instance 632d02cd-2985-4976-944b-0a5c9acf06c6 on hv-cinder-83602 Aug 10 13:29:13.388743 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:13.389276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:13.389769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:13.390427 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:13.390880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:13.405915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-cb26cacd-f3b7-4158-a927-9f6b9c6bbaa5 req-ffeed68a-971b-4cf3-be17-57d5af04b8a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098540 Aug 10 13:29:13.408445 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:13.412154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 254/501] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:13.424968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:13.433467 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:13.456513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:13.458180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:13.459813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:13.460703 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:13.463472 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:13.464584 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:13.492353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 HTTP/1.1 Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:29:13.504413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:29:13.505872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '632d02cd-2985-4976-944b-0a5c9acf06c6'} Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:29:13.506819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:29:13.508248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:13.511377 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:29:13.515167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cb96ccbd-510d-43b9-a46e-718a8e8e896a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 404 len: 111 microversion: 2.1 time: 0.096379 Aug 10 13:29:13.523132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 255/502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:13 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:29:13.532484 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6fffc7e6-704f-4553-85e9-df986892ac4c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '.version_select at 0x7ff6a8197ca0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:13.642963 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6fffc7e6-704f-4553-85e9-df986892ac4c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865558630" status: 202 len: 0 microversion: 2.1 time: 0.118528 Aug 10 13:29:13.647710 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 256/503] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Aug 10 13:29:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865558630 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:29:13.817588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:13.833381 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-cdfbe39e-f1df-4726-b339-5d22656d8e51 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.520738 Aug 10 13:29:13.839922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 248/504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:13 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:14.001759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:14.002730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:14.013842 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:14.014631 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:14.015515 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:14.016768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:14.017471 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:14.018116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:14.241371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:14.247001 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:14.260429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:14.261661 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:14.279276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:14.279276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:14.279276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:14.279276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:14.601317 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:14.614348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:14.616285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:14.622437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-53533d72-f5b9-4b63-bbee-89bb483fd3d0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.623702 Aug 10 13:29:14.637572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 257/505] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:13 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:14.665092 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:14.665710 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:14.695491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:14.698087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:14.698763 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:14.709170 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:14.711327 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:14.715288 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:14.820353 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:14.836142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e83456c1-987c-41ac-b1b3-5d34d6eabc82 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.600087 Aug 10 13:29:14.845243 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 249/506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:14 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:14.865473 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:14.866685 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:14.884780 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:14.885773 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:14.886462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:14.888099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:14.888831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:14.902044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:15.212093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:15.221886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c4064567-27cf-4aa6-be42-1160188615c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.360888 Aug 10 13:29:15.235895 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 250/507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:14 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:15.239332 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-917d919e-ee04-4b28-8398-1e89a5c9b55e req-99c2d22b-12e6-448b-a64f-a19aac03fbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88fd6a8-9262-4f5c-9b91-ed4e70704cb9", "name": "network-vif-plugged", "status": "completed", "tag": "ea8828a3-61d3-4d2e-9d76-db0b898a6fd4"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:15.272014 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-917d919e-ee04-4b28-8398-1e89a5c9b55e req-99c2d22b-12e6-448b-a64f-a19aac03fbdf service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:15.272815 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-917d919e-ee04-4b28-8398-1e89a5c9b55e req-99c2d22b-12e6-448b-a64f-a19aac03fbdf service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:15.273618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-917d919e-ee04-4b28-8398-1e89a5c9b55e req-99c2d22b-12e6-448b-a64f-a19aac03fbdf service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:15.309630 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-917d919e-ee04-4b28-8398-1e89a5c9b55e req-99c2d22b-12e6-448b-a64f-a19aac03fbdf service nova] Creating event network-vif-plugged:ea8828a3-61d3-4d2e-9d76-db0b898a6fd4 for instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 on hv-cinder-83602 Aug 10 13:29:15.422117 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-917d919e-ee04-4b28-8398-1e89a5c9b55e req-99c2d22b-12e6-448b-a64f-a19aac03fbdf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092305 Aug 10 13:29:15.422117 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 251/508] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:15.422376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:15.422376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cfa88532-bdef-44a3-b0e6-8f05445396bd tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.734021 Aug 10 13:29:15.422376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 258/509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:14 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:15.661745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:15.662455 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:15.693852 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:15.703000 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:15.705224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:15.706207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:15.708402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:15.712716 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:15.760856 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-2a3e633c-e9eb-4413-9f85-da4d147e1f50 req-18d13820-36db-4061-a4d8-ae1503e1fbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c04cd31-0203-46ab-bee8-1cdaf27c3e34", "tag": "273e8b95-1ed6-4f94-a5b2-d256242f35e1"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:15.820690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:15.827022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-2a3e633c-e9eb-4413-9f85-da4d147e1f50 req-18d13820-36db-4061-a4d8-ae1503e1fbe1 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:15.827531 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-2a3e633c-e9eb-4413-9f85-da4d147e1f50 req-18d13820-36db-4061-a4d8-ae1503e1fbe1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:15.827969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-2a3e633c-e9eb-4413-9f85-da4d147e1f50 req-18d13820-36db-4061-a4d8-ae1503e1fbe1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:15.888809 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-2a3e633c-e9eb-4413-9f85-da4d147e1f50 req-18d13820-36db-4061-a4d8-ae1503e1fbe1 service nova] Creating event network-changed:273e8b95-1ed6-4f94-a5b2-d256242f35e1 for instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 on hv-cinder-83602 Aug 10 13:29:15.905488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-2a3e633c-e9eb-4413-9f85-da4d147e1f50 req-18d13820-36db-4061-a4d8-ae1503e1fbe1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147923 Aug 10 13:29:15.908593 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 259/510] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:29:15.931179 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:15.936750 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:15.952478 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:15.953413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:15.954029 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:15.954945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:15.956547 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:15.958087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:16.321283 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:16.334937 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-768d7099-0a0e-4231-a995-7f9f993ed43a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.425053 Aug 10 13:29:16.353170 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 260/511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:15 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:16.361133 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ea165a59-1202-4754-b94d-b2aae7b4ec6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: .version_select at 0x7ff6a846fa60>, body: {"keypair": {"name": "tempest-keypair-179747253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpxloB89CaJ3J1RKUqJEsbEB+035Ro3DWsGxb90wFgqSoXg4jfKUtHrfHaMg1puMSJ6L+smfP7OJUxBCNLFKxtd6lfTMpPLAuLiKx/XX05ztHT89KsK8+poyw3rDlNabA=="}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:16.384666 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-ea165a59-1202-4754-b94d-b2aae7b4ec6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for project 26a97b47cc804e598c5e8680d279de19. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:29:16.392118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-ea165a59-1202-4754-b94d-b2aae7b4ec6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for user c9577bc4c4c546ca9fc220ebd3a16346 and project 26a97b47cc804e598c5e8680d279de19. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:29:16.460235 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:16.471718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:16.474492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:16.476250 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-96e02b25-d752-4e38-861e-b133293d5c82 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.832491 Aug 10 13:29:16.477826 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 252/512] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:15 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:16.484979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:16.485954 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:16.493946 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:16.498266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:16.498266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:16.498266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:16.498266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:16.498596 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:16.512687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ea165a59-1202-4754-b94d-b2aae7b4ec6f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156767 Aug 10 13:29:16.513488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 261/513] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:29:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:16.523089 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:16.528158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:16.545793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:16.546391 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:16.546840 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:16.547689 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:16.548341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:16.551772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:16.769865 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:16.781854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5d25baf6-31ad-49a5-9f19-286a9dd0858a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.300572 Aug 10 13:29:16.782784 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 253/514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:16 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:16.832609 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:16.854285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-be302b08-1069-4feb-ae40-9792bf7f4550 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.338118 Aug 10 13:29:16.857921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 262/515] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:16 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:17.363039 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:17.366469 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:17.374743 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:17.380862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:17.380862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:17.380862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:17.380862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:17.381285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:17.500362 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:17.501310 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:17.514628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:17.515138 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:17.515588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:17.516574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:17.517054 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:17.523298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:17.731606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:17.753151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-188021f1-02ad-4957-919e-be3ae8f64628 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.385488 Aug 10 13:29:17.753151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 254/516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:17 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:17.804762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:17.805856 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:17.817947 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:17.818779 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:17.819279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:17.822103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:17.822103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:17.822103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:17.920229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:17.943250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:17.944053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:17.945344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-184b549e-a9d0-44b5-9e7e-437d673dde8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.449576 Aug 10 13:29:17.945904 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 263/517] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:17 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:17.951964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:17.953216 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:17.959498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:17.959988 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:17.961477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:17.961477 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:17.961795 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:17.966575 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:18.019506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:18.031968 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4fa5d01f-2593-4114-a37a-5d2414d1b0e2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.231872 Aug 10 13:29:18.032552 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 255/518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:17 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:18.116927 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:18.125754 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-50995f95-50fb-4e35-a61a-f485d8e8d7a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.178826 Aug 10 13:29:18.126353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 264/519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:17 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:18.781497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:18.782376 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:18.784566 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:18.785714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=10 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:18.799464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:18.800260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:18.800913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:18.801809 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:18.805741 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:18.806427 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:18.974901 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:18.976271 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:18.994794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:18.999080 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:18.999901 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:19.000814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:19.003666 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:19.004298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:19.104499 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:19.108197 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=100 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:19.112752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c5c4f396-04af-4097-9ff7-ac363a38a5a7 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.335440 Aug 10 13:29:19.113364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 256/520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:18 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:19.148043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:19.148043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:19.148043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:19.148043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:19.148363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:19.148363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:19.148363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:19.148363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:19.325768 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:19.333996 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4e44bb5f-aefb-44a0-9fae-5e80a79c2f14 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.211830 Aug 10 13:29:19.335900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 257/521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:19 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:19.355367 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:19.357390 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:19.364755 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:19.365361 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:19.365855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:19.366665 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:19.367486 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:19.368010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:19.451762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:19.463643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:19.465266 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:19.469254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-db164d96-1f5a-4413-a60a-8a016137d1f0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.495761 Aug 10 13:29:19.472514 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 265/522] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:18 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:19.608611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:19.620489 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a6c5ac07-13e2-4cef-9ec0-53aa32811e09 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.272087 Aug 10 13:29:19.621215 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 258/523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:19 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:20.141468 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:20.142430 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:20.171588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:20.172503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:20.173376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:20.174393 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:20.175058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:20.175651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:20.360114 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:20.364173 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:20.378416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:20.387766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:20.389808 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:20.390705 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:20.401594 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:20.402093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:20.633548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:20.667347 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b7248fd6-47df-4fa1-b983-81704f14d7fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.531557 Aug 10 13:29:20.669432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 266/524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:20 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:20.676218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:20.677046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:20.701412 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:20.703440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:20.704051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:20.713727 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:20.715270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:20.717805 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:20.772471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:20.789160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b07c6024-0877-4f79-8eaf-7ea513542347 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.430987 Aug 10 13:29:20.802677 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 259/525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:20 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:20.805098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:20.809370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:20.818392 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:20.819267 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:20.819974 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:20.821798 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:20.830812 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:20.831695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:21.041562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:21.052777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:21.054621 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:21.060567 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-420b351e-c244-4b51-8af7-b6d8f57cf81d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.384146 Aug 10 13:29:21.060567 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 267/526] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:20 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:21.063515 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-398738797", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0166bef-5b21-4630-8f39-894ba8f20530"}], "security_groups": [{"name": "tempest-securitygroup--1050810279"}], "key_name": "tempest-keypair-179747253", "user_data": "}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:21.100923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:21.100923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2a29c7cd-6d37-45fe-8ef4-498b90b742a9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.304015 Aug 10 13:29:21.100923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 260/527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:20 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:21.690570 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:21.691211 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:21.693496 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:21.698094 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:21.698577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:21.699012 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:21.700217 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:21.700666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:21.701126 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:21.881600 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:21.891447 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-25a62c73-abd6-47bb-9546-45348514c0c1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1675 microversion: 2.1 time: 0.204374 Aug 10 13:29:21.892150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 261/528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:21 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:21.896980 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:21.897687 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:21.908935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:21.908935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:21.908935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:21.908935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:21.909397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:21.909397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:22.194225 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:22.211040 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2610f25e-0dc1-4460-b964-3011b7e90653 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.317693 Aug 10 13:29:22.215336 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 262/529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:21 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:22.234305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:22.237047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:22.245399 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:22.245990 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:22.247493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:22.248482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:22.248962 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:22.249403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:22.559817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:22.568814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:22.572955 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:22.576809 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-dfd207e6-afd2-495e-a5f4-7a1a40d74648 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.355984 Aug 10 13:29:22.578437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 263/530] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:22 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:22.584022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:22.584022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:22.608651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:22.609190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:22.609708 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:22.610424 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:22.610887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:22.611352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:22.852127 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:22.864077 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e3dea624-1143-485b-b98c-74f42c3ae4f0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.284532 Aug 10 13:29:22.864749 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 264/531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:22 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:22.916618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:22.917389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:22.939603 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:22.941988 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:22.943930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:22.945022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:22.946915 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:22.948209 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:23.218689 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:23.234461 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f4920a0b-7c32-48fb-8b1b-72b735e34591 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1652 microversion: 2.1 time: 0.321000 Aug 10 13:29:23.239191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 265/532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:22 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1652 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:23.246316 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:23.247233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:23.260033 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:23.260762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:23.262695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:23.264055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:23.264911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:23.265730 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:23.497220 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:23.507158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9cb3ae35-b679-47e2-968f-36a834e3b9cd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.266298 Aug 10 13:29:23.522134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 266/533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:23 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:23.529253 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-78026e47-204c-464e-a47e-e2eb4f8fa6fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:23.538627 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-78026e47-204c-464e-a47e-e2eb4f8fa6fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:23.539414 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-78026e47-204c-464e-a47e-e2eb4f8fa6fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:23.540055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-78026e47-204c-464e-a47e-e2eb4f8fa6fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:23.576465 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-78026e47-204c-464e-a47e-e2eb4f8fa6fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Going to try to start instance {{(pid=118003) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 13:29:24.259804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-78026e47-204c-464e-a47e-e2eb4f8fa6fd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/action" status: 202 len: 0 microversion: 2.1 time: 0.726572 Aug 10 13:29:24.259804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 267/534] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:29:23 2022] POST /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:29:24.274455 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:24.280935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:24.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:24.298274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:24.299512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:24.299741 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:24.300241 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:24.312862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:24.531615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:24.542287 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:24.544708 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:24.547082 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-496338b5-339c-484d-b02e-c8c28e919f4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.294485 Aug 10 13:29:24.547809 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 268/535] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:24 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:24.569394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:24.570801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:24.580745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:24.580745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:24.580745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:24.581716 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:24.581952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:24.582417 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:24.895573 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:24.909922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-df120f4f-2eaa-49eb-90e1-e4c062bc2266 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.338825 Aug 10 13:29:24.921976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 269/536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:24 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:24.921976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:24.921976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:24.928275 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:24.930751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:24.935754 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:24.936861 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:24.937528 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:24.938125 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:25.205809 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:25.214422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c8f34e31-e5b7-48cd-8cb8-9f3b6f9709ca tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1661 microversion: 2.1 time: 0.302352 Aug 10 13:29:25.231009 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 270/537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:24 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1661 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:25.238577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:25.243438 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:25.250736 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:25.251664 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:25.252283 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:25.253195 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:25.253811 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:25.254398 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:25.451971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:25.472895 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e7d2cdc3-12a6-458d-8e5f-98e2b252e4b5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.231867 Aug 10 13:29:25.472895 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 271/538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:25 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:25.572241 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:25.572838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:25.597048 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:25.597048 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:25.597048 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:25.598338 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:25.600213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:25.600784 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:25.625025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:25.883852 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:25.892131 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:25.893922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:25.895199 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1f35a523-9ede-4109-b9db-29c571eb4390 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.327009 Aug 10 13:29:25.895758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 272/539] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:25 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:25.936363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:25.936965 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:25.943510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:25.943990 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:25.946187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:25.946187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:25.946187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:25.946187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.110465 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:26.118382 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d8beb129-0057-47d7-aef8-7b7e683d2a60 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.186664 Aug 10 13:29:26.118937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 273/540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:25 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:26.240205 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:26.240821 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:26.268546 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.269261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.269862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.270598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.271220 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.273219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.415680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:26.522193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:26.535188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-45519cf1-2f76-47a1-bab8-534bd3f66783 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1661 microversion: 2.1 time: 0.299393 Aug 10 13:29:26.536203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 274/541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:26 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1661 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:26.541834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:26.546902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:26.551606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.552102 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.552607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.553277 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.553911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.554323 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.802650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:26.816937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1aa8d857-77b4-4c2c-ba8c-9998a4467955 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.278349 Aug 10 13:29:26.819313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 275/542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:26 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:26.928093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:26.929243 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:26.936874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.937398 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.938023 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.939062 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.939672 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.940608 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.081216 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:27.089172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:27.091328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:27.092487 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3832543b-742e-4f2d-8cf3-1fc8dc886419 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.177248 Aug 10 13:29:27.093064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 276/543] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:26 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:27.140904 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:27.141554 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:27.147687 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:27.148234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:27.148672 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.149390 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:27.149842 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:27.150265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.281020 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:27.289342 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d18f9b90-109f-4b1f-b61e-d1ab153aade6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.152888 Aug 10 13:29:27.289910 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 277/544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:27 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:27.518350 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] validate_networks() for [('e0166bef-5b21-4630-8f39-894ba8f20530', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:29:27.556562 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:27.557192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:27.564127 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:27.564614 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:27.565148 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.565853 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:27.566305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:27.566726 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.708360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:27.717412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9139f86a-2729-4695-b24e-433f1e98e532 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1665 microversion: 2.1 time: 0.164824 Aug 10 13:29:27.721981 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 278/545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:27 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:27.842841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:27.843446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:27.849585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:27.850069 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:27.850502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.851186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:27.851677 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:27.852101 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.892983 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:29:27.893432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:29:27.893905 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:29:27.894322 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:29:27.894730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:29:27.903558 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:27.904038 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:27.904472 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.905228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:27.905684 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:27.906106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:27.923101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for project 26a97b47cc804e598c5e8680d279de19. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:29:27.927004 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for user c9577bc4c4c546ca9fc220ebd3a16346 and project 26a97b47cc804e598c5e8680d279de19. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:29:27.938708 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:29:27.946062 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:29:27.983629 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:27.990955 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d2186099-c289-441e-8f67-7d402eadf99f tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.152102 Aug 10 13:29:27.991535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 279/546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:27 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:28.077173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7aa6b777-cca6-4df5-8564-1e5040a4b938 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.019161 Aug 10 13:29:28.077812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 268/547] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:29:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 7020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:29:28.088635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5e344cb9-8705-48ea-a2e5-0bbf73658e7c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:28.095014 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5e344cb9-8705-48ea-a2e5-0bbf73658e7c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:28.115552 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:28.116166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:28.123025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:28.123514 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:28.123952 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:28.124653 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:28.125147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:28.125585 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:28.143625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5e344cb9-8705-48ea-a2e5-0bbf73658e7c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:28.152005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5e344cb9-8705-48ea-a2e5-0bbf73658e7c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1240 microversion: 2.1 time: 0.067011 Aug 10 13:29:28.152749 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 280/548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:28 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:28.263771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:28.271792 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:28.276431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:28.276431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a33cd1ca-2b8b-4e97-992a-4bba1ddc04a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.162813 Aug 10 13:29:28.276431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 269/549] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:28 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:28.313197 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:28.313802 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:28.319893 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:28.320370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:28.320798 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:28.321509 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:28.321957 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:28.322377 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:28.456721 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:28.467087 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a04e9265-826b-4ee0-93cf-768e76fb0135 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.156629 Aug 10 13:29:28.468121 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 281/550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:28 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:29.012172 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:29.012781 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:29.018834 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:29.021125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:29.021125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:29.021125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:29.021125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:29.021473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:29.025256 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:29.148711 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:29.156785 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-85526bb8-800c-4589-b8be-0b4b05198b87 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.148746 Aug 10 13:29:29.157382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 270/551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:29 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:29.173904 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:29.174520 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:29.180960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:29.181482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:29.181986 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:29.182680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:29.183172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:29.183745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:29.255307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:29.263381 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fdacfe23-3dbb-4c5f-b606-366023ed2f16 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1244 microversion: 2.1 time: 0.093304 Aug 10 13:29:29.263952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 282/552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:29 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:29.298501 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:29.299104 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:29.305487 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:29.305962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:29.306393 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:29.307071 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:29.307521 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:29.307945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:29.436905 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:29.444893 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:29.446545 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:29.447701 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4375aeb6-23fe-4b66-b442-d969704af52d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.153382 Aug 10 13:29:29.448267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 271/553] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:29 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:29.488512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:29.489138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:29.495429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:29.496678 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:29.497039 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:29.497785 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:29.498238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:29.498656 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:29.624557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:29.632517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7bf02df0-2c50-4047-8fc9-c93880ea4eca tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.147808 Aug 10 13:29:29.633103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 283/554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:29 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:30.178379 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:30.179031 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:30.186160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:30.186693 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:30.187133 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:30.187821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:30.188275 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:30.188699 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:30.284379 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:30.285310 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:30.291744 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:30.292228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:30.293405 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:30.294162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:30.294621 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:30.295048 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:30.322136 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:30.329729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6e945c82-0109-4a8a-99a3-06b3d9bb00ac tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.155223 Aug 10 13:29:30.330301 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 272/555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:30 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:30.360344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:30.367798 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ed4f01a7-b953-40d0-bbb6-6d7989b0a4dd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1244 microversion: 2.1 time: 0.087316 Aug 10 13:29:30.368357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 284/556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:30 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:30.471332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:30.471903 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:30.477894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:30.478374 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:30.478820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:30.479507 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:30.479977 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:30.481028 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:30.626653 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:30.635438 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:30.637046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:30.638402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0287ded7-293d-44ce-819e-232cfa5ca30e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.171046 Aug 10 13:29:30.654437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 273/557] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:30 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:30.664272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:30.664886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:30.671663 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:30.672163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:30.672598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:30.673501 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:30.674064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:30.674490 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:30.807392 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:30.816187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d7e9b8de-ff8f-48e4-ad13-1ee2a18bee97 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.157304 Aug 10 13:29:30.816769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 285/558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:30 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:31.350677 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:31.351281 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:31.358935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:31.359422 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:31.359860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:31.360616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:31.361124 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:31.361557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:31.388271 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:31.388874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:31.395551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:31.396027 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:31.396456 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:31.397169 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:31.397620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:31.403857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:31.470246 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:31.477811 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-927b904b-b7a0-4097-ae85-2015e0e7503d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1244 microversion: 2.1 time: 0.093337 Aug 10 13:29:31.478435 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 286/559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:31 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:31.498340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:31.505820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5a0056fa-c854-4315-bbaa-dde76e6e7ab0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.158986 Aug 10 13:29:31.506378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 274/560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:31 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:31.667992 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:31.668638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:31.675084 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:31.675573 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:31.676011 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:31.676711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:31.677215 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:31.677633 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:31.811678 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:31.819863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:31.821475 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:31.822632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c92424ee-167e-4e2b-8f80-598e500d2ee2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1740 microversion: 2.20 time: 0.158880 Aug 10 13:29:31.823185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 287/561] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:31 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:31.836402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:31.838826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:31.843481 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:31.843955 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:31.844390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:31.845228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:31.845684 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:31.846112 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:31.984178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:31.993396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f4c07029-7262-48a1-a307-ee95c1e3ecb7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.160827 Aug 10 13:29:31.993965 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 275/562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:31 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:32.498776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:32.499463 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:32.506379 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:32.507031 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:32.507463 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:32.508158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:32.508637 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:32.509291 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:32.525815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:32.528119 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:32.534060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:32.535016 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:32.535600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:32.536534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:32.537160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:32.537720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:32.581600 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:32.589725 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-059fd49b-a40d-4430-9d89-4e25fb74cdd2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1236 microversion: 2.1 time: 0.094939 Aug 10 13:29:32.591277 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 288/563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:32 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1236 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:32.673452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:32.681314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c81e9ca3-0fd7-4cd5-9524-3e36807adb11 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.159269 Aug 10 13:29:32.681883 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 276/564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:32 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:32.847293 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:32.847932 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:32.853870 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:32.854361 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:32.854795 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:32.855675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:32.856141 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:32.856573 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:32.988755 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:32.997294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:32.998806 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:32.999964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-07f35216-a83d-4634-baa1-0dd839038644 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1722 microversion: 2.20 time: 0.156641 Aug 10 13:29:33.001378 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 289/565] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:32 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:33.014904 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:33.015556 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:33.021758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:33.022251 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:33.022749 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:33.023471 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:33.023930 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:33.024401 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:33.156679 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:33.165392 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-819ed735-4954-40f6-8784-f148e32a681d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.154477 Aug 10 13:29:33.165972 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 277/566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:33 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:33.611885 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:33.612490 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:33.619126 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:33.619664 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:33.620091 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:33.620859 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:33.621362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:33.626016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:33.626278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=100 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:33.707967 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:33.710544 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:33.711172 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:33.721899 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0fe9c1d2-4afe-45f6-80b3-543964ceaeea tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1236 microversion: 2.1 time: 0.113595 Aug 10 13:29:33.728692 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:33.730174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:33.730974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:33.731936 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:33.732721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:33.733359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:33.736285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 290/567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:33 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1236 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:33.877923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:33.885581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9c7aee66-b241-4d32-9f5a-cb1efe509898 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.187154 Aug 10 13:29:33.886713 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 278/568] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:33 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:34.023289 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:34.023930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:34.031294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:34.031866 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:34.032554 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:34.033703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:34.034374 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:34.035220 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:34.186834 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:34.187443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:34.193654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:34.194143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:34.194580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:34.195278 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:34.195730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:34.196153 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:34.336986 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:34.345838 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7b65705a-f558-4b68-8be8-f32d7f4f5462 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1736 microversion: 2.1 time: 0.163661 Aug 10 13:29:34.346409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 279/569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:34 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:34.423817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:34.432046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:34.433813 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:34.434986 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2dbbe729-6a18-442e-acc9-ce99f1179504 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1722 microversion: 2.20 time: 0.415888 Aug 10 13:29:34.435740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 291/570] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:34 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1722 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:34.744341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:34.745168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:34.752505 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:34.753008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:34.753458 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:34.754160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:34.754615 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:34.755044 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:34.825473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:34.833417 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4811ef0b-956c-44ce-9343-67a308ff2902 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1292 microversion: 2.1 time: 0.094022 Aug 10 13:29:34.837243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 280/571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:34 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:34.906909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:34.907542 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:34.914241 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:34.914643 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:34.915073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:34.915765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:34.916217 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:34.916639 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.144432 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:35.152455 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b5c28545-9fd4-4b3c-ac53-1e0b11aa4da8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.248898 Aug 10 13:29:35.153049 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 292/572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:34 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:35.367630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:35.368228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:35.375022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.375504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.375938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.376620 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.377110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.377538 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.462020 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:35.465740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:35.469160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.469846 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.470449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.471305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.471915 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.472504 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.514575 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:35.523346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cfae753a-ca98-419f-a838-600582e3f97f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1716 microversion: 2.1 time: 0.159512 Aug 10 13:29:35.537167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 281/573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:35 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:35.627478 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:35.639267 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:35.643548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:35.643548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-cec868aa-5a99-4ece-9bb2-ab3daed759c8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1722 microversion: 2.20 time: 0.187815 Aug 10 13:29:35.657461 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 293/574] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:35 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:35.680326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:35.680821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:35.687086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.687568 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.688002 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.688740 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.689235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.689666 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.711441 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-d802b5a4-c531-4c50-a990-16100440de30 req-a4124320-f3c9-42ed-aec3-5fbc25b30476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c04cd31-0203-46ab-bee8-1cdaf27c3e34", "name": "network-vif-plugged", "status": "completed", "tag": "273e8b95-1ed6-4f94-a5b2-d256242f35e1"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:35.722111 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d802b5a4-c531-4c50-a990-16100440de30 req-a4124320-f3c9-42ed-aec3-5fbc25b30476 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.724568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d802b5a4-c531-4c50-a990-16100440de30 req-a4124320-f3c9-42ed-aec3-5fbc25b30476 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.724568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d802b5a4-c531-4c50-a990-16100440de30 req-a4124320-f3c9-42ed-aec3-5fbc25b30476 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.735688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-d802b5a4-c531-4c50-a990-16100440de30 req-a4124320-f3c9-42ed-aec3-5fbc25b30476 service nova] Creating event network-vif-plugged:273e8b95-1ed6-4f94-a5b2-d256242f35e1 for instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 on hv-cinder-83602 Aug 10 13:29:35.740482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-d802b5a4-c531-4c50-a990-16100440de30 req-a4124320-f3c9-42ed-aec3-5fbc25b30476 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033056 Aug 10 13:29:35.741434 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 294/575] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:29:35.779414 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] HTTP exception thrown: Cannot 'detach_volume' instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 while it is in vm_state rescued Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Request method failure captured: Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: DELETE /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments/b8b935f4-bdc8-4a66-b020-e3cd2fc0e92a HTTP/1.1 Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HI8d6dqhS5K-ZbrX184FWe_fKIHc4FnlHdDzwnLTq8-Y3JD5vSjoVyD0ZRKwi7HBpcs2JMi38-2hM5ZGw9WCKfkOWYwVBtjiwW4NDea0c2b5B7VAoskt-n6HGpwWC7Ob_NVt3sYHk6M9GNnMMsYUc7WWG-Zoyju8lMuZrQ63R0c1s Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:29:35.782032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0c9fae66a6f4ac9a0c1b0629e597906", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 4dfd3ee79da943b189824630b5c393ee Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:29:35.783748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Cannot 'detach_volume' instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 while it is in vm_state rescued Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'server_id': 'e0788538-19b6-4d2b-ab3f-521dbd8cc729', 'id': 'b8b935f4-bdc8-4a66-b020-e3cd2fc0e92a'} Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:29:35.784818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 while it is in vm_state rescued Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 while it is in vm_state rescued Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:29:35.786426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Returning 409 to user: Cannot 'detach_volume' instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 while it is in vm_state rescued {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:29:35.787657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a4f7cc02-88f4-434e-b7e0-f0685fedf41b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments/b8b935f4-bdc8-4a66-b020-e3cd2fc0e92a" status: 409 len: 152 microversion: 2.1 time: 0.106414 Aug 10 13:29:35.787657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 282/576] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:29:35 2022] DELETE /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments/b8b935f4-bdc8-4a66-b020-e3cd2fc0e92a => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 13:29:35.793945 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:35.794694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:35.800864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.801383 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.805028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.805028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.805028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.805028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.854376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:35.855252 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:35.861584 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.862063 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.862491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.863366 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:35.863798 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:35.864213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:35.931544 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:35.940037 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c5e14120-cff9-46bf-a954-54397175741a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1298 microversion: 2.1 time: 0.089432 Aug 10 13:29:35.940605 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 283/577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:35 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:35.993120 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-663b01b3-cb7f-4638-ad79-eccc9c3b1c1f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "POST /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/action" status: 202 len: 0 microversion: 2.1 time: 0.204532 Aug 10 13:29:35.993935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 295/578] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:29:35 2022] POST /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:29:36.002109 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:36.002724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:36.013068 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:36.013068 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:36.013068 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:36.013068 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:36.013577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:36.013687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:36.150746 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:36.159864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c65adb62-ee3f-4eed-90c5-655bbcfa6437 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1724 microversion: 2.1 time: 0.161389 Aug 10 13:29:36.160429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 284/579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:35 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:36.175094 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:36.176068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:36.182372 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:36.182930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:36.183494 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:36.184192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:36.184641 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:36.185158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:36.315693 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:36.323105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1643c7c7-17e2-46ff-a74f-9dfee643c196 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.152852 Aug 10 13:29:36.324474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 296/580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:36 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:36.666122 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:36.667040 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:36.674506 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:36.675125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:36.675734 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:36.676780 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:36.677527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:36.678116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:36.809310 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:36.817309 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:36.818869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:36.820033 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7b15f9c0-041d-4ec3-9608-d8e675dc1c2e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1722 microversion: 2.20 time: 0.158234 Aug 10 13:29:36.820591 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 285/581] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:36 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:36.961865 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:36.962402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:36.969943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:36.970426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:36.970860 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:36.971551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:36.972008 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:36.972436 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:37.046789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:37.054105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-07bf2dd7-9519-441b-bb90-f6b3fde91a32 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1298 microversion: 2.1 time: 0.096155 Aug 10 13:29:37.054663 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 297/582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:36 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:37.180523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:37.181135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:37.187854 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:37.188335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:37.188772 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:37.189491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:37.189961 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:37.190401 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:37.348915 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:37.349992 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:37.350698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:37.354232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:37.357390 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:37.358166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:37.358841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:37.359873 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:37.360343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-347d53b5-2145-4fb6-8109-deffea4d6339 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1724 microversion: 2.1 time: 0.183685 Aug 10 13:29:37.360731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:37.361278 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 286/583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:37 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:37.361566 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:37.595961 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:37.603686 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9564a09c-92e0-45a7-8105-414fbd094034 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.259512 Aug 10 13:29:37.604257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 298/584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:37 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:37.760838 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-ef8768bc-7d2c-460c-acc4-014498e3e1a9 req-4728e89d-b7a0-4788-a0ec-7ab3ed26004d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88fd6a8-9262-4f5c-9b91-ed4e70704cb9", "name": "network-vif-unplugged", "status": "completed", "tag": "ea8828a3-61d3-4d2e-9d76-db0b898a6fd4"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:37.774339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-ef8768bc-7d2c-460c-acc4-014498e3e1a9 req-4728e89d-b7a0-4788-a0ec-7ab3ed26004d service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:37.774817 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-ef8768bc-7d2c-460c-acc4-014498e3e1a9 req-4728e89d-b7a0-4788-a0ec-7ab3ed26004d service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:37.775245 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-ef8768bc-7d2c-460c-acc4-014498e3e1a9 req-4728e89d-b7a0-4788-a0ec-7ab3ed26004d service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:37.790316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-ef8768bc-7d2c-460c-acc4-014498e3e1a9 req-4728e89d-b7a0-4788-a0ec-7ab3ed26004d service nova] Creating event network-vif-unplugged:ea8828a3-61d3-4d2e-9d76-db0b898a6fd4 for instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 on hv-cinder-83602 Aug 10 13:29:37.795480 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-ef8768bc-7d2c-460c-acc4-014498e3e1a9 req-4728e89d-b7a0-4788-a0ec-7ab3ed26004d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041359 Aug 10 13:29:37.796082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 287/585] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:37.844040 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:37.844788 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:37.850970 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:37.851520 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:37.852245 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:37.852986 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:37.853534 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:37.854022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.072540 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:38.073333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:38.078393 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:38.079102 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:38.085282 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:38.085765 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:38.086204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.086893 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:38.087344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:38.087763 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.116306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:38.125873 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:38.127644 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:38.129100 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ce5c7a4a-aa1e-4cc8-beec-010ded7a36a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1725 microversion: 2.20 time: 0.289047 Aug 10 13:29:38.130328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 299/586] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:37 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:38.153452 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b32cef7-ac09-4b3b-b5c3-078dc8e79e2a"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:38.155919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:38.158060 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:38.163187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:38.163717 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:38.164147 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.164857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:38.165315 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:38.165737 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.168163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:38.175425 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-73311ab8-1e12-4dc7-aa23-a681b5db70f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1298 microversion: 2.1 time: 0.103906 Aug 10 13:29:38.175993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 288/587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:38 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:38.382712 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:38.383325 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:38.390576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:38.391059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:38.391495 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.392190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:38.392643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:38.393092 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.527690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:38.535919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-73777e31-668d-42a1-81f2-bc314d2621b4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1724 microversion: 2.1 time: 0.157672 Aug 10 13:29:38.536683 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 289/588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:38 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:38.626183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:38.626937 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:38.635871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:38.636419 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:38.636926 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.637640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:38.638101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:38.638561 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:38.806460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:38.814550 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c218c2c5-67c7-4bb9-aeaa-68b6a7b1bb76 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1357 microversion: 2.1 time: 0.194107 Aug 10 13:29:38.815118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 290/589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:38 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:39.200604 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:39.201388 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:39.207614 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.208103 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.208785 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.211678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.212085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.212584 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.310487 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e21c2fe4-7ec8-44f7-b6c2-92a87deb2f3f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.161002 Aug 10 13:29:39.311558 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 300/590] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Aug 10 13:29:38 2022] POST /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments => generated 188 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:29:39.356612 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:39.364326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1b9bee25-f5f1-4183-b647-f2db08471bef tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.168655 Aug 10 13:29:39.365125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 291/591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:39 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:39.461156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:39.461994 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:39.469364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.470139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.474615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.474615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.474615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.474615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.521408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118003) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 13:29:39.564299 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:39.565679 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:39.579033 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.580010 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.580888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.582251 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.583099 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.583911 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.752055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:39.760338 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ef244cbc-241a-41ac-9901-1f41215e2e0d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1724 microversion: 2.1 time: 0.205073 Aug 10 13:29:39.760953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 292/592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:39 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:39.767165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-e3d9a3c1-4f88-4011-bbea-5b8c515beab7 req-8493328d-522a-4dd6-914e-ff3dffd25074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c655ab7-4709-47e3-88ea-1841fa80d3fe", "tag": "4811b202-c18c-4dab-82bd-c56b9dcb0764"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:39.778030 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e3d9a3c1-4f88-4011-bbea-5b8c515beab7 req-8493328d-522a-4dd6-914e-ff3dffd25074 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.778522 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e3d9a3c1-4f88-4011-bbea-5b8c515beab7 req-8493328d-522a-4dd6-914e-ff3dffd25074 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.778923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e3d9a3c1-4f88-4011-bbea-5b8c515beab7 req-8493328d-522a-4dd6-914e-ff3dffd25074 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.789957 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-e3d9a3c1-4f88-4011-bbea-5b8c515beab7 req-8493328d-522a-4dd6-914e-ff3dffd25074 service nova] Creating event network-changed:4811b202-c18c-4dab-82bd-c56b9dcb0764 for instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe on hv-cinder-83602 Aug 10 13:29:39.795899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-e3d9a3c1-4f88-4011-bbea-5b8c515beab7 req-8493328d-522a-4dd6-914e-ff3dffd25074 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032071 Aug 10 13:29:39.797234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 293/593] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:39.805059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-335037ac-fc89-43bd-9ba1-bbdfac02e941 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/action" status: 202 len: 0 microversion: 2.20 time: 0.348081 Aug 10 13:29:39.805749 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 301/594] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Aug 10 13:29:39 2022] POST /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:29:39.815001 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:39.815720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:39.822046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.822510 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.822942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.823840 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.824606 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.825056 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.838047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:39.838584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:39.844663 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.845176 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.846188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.846885 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:39.847337 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:39.847755 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:39.972645 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:39.983399 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:39.984893 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:39.986179 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-efc662ee-0793-4790-b29d-4389ecc53d81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1751 microversion: 2.20 time: 0.175486 Aug 10 13:29:39.987294 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 294/595] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:39 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:39.994887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:40.000121 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:40.005237 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b3304236-cbc2-4b25-92c5-d1473defc45c tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1547 microversion: 2.1 time: 0.171052 Aug 10 13:29:40.005891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 302/596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:39 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:40.029657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:40.030278 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:40.036775 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.037116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.037825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.038556 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.039008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.039429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.175045 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:40.182591 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7844970b-5c5d-4a81-a655-d249e07db6d5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1547 microversion: 2.1 time: 0.158980 Aug 10 13:29:40.183667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 295/597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:40 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:40.204289 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:40.209394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:40.210112 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Searching by: {'deleted': False, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008'} {{(pid=118003) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 13:29:40.217637 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.218110 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.218533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.219239 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.219682 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.220097 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.313917 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.multi_cell_list [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118003) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 13:29:40.386975 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:40.387642 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:40.390594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:40.394010 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.394493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.394925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.395616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.396065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.396482 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.410726 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9f5e1f9e-df45-4aad-8c4f-c35fcaf6a335 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210685 Aug 10 13:29:40.418142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 303/598] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Aug 10 13:29:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:40.423387 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:40.424006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:40.430183 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.430672 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.431103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.432025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.432674 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.433851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.574817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:40.583691 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0d9ac460-68bf-49fb-b90f-ada2e2305503 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1547 microversion: 2.1 time: 0.164021 Aug 10 13:29:40.584683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 304/599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:40 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:40.586491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:40.594511 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e09f961d-26be-45bc-a1b6-5ab814b54dda tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.212118 Aug 10 13:29:40.595072 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 296/600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:40 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:40.781965 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:40.782696 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:40.790068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.790068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.791187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.791899 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:40.792977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:40.793395 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:40.972568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:40.989088 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f2344042-1329-4d32-b723-32f14783c45c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1724 microversion: 2.1 time: 0.210916 Aug 10 13:29:40.989969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 305/601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:40 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:41.012976 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:41.013724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:41.021418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:41.021960 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:41.022571 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:41.023435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:41.027662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:41.027662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:41.167542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:41.176659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:41.178249 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:41.179422 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2c9f0fb6-2e88-46df-a799-af8df393face tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1751 microversion: 2.20 time: 0.171737 Aug 10 13:29:41.179983 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 297/602] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:41 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:41.615782 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:41.616744 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:41.623405 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:41.623890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:41.624322 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:41.625042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:41.625497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:41.625920 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:41.936737 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:41.944457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e96d5033-3708-4056-abf0-f70263f383e7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.332508 Aug 10 13:29:41.957201 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 306/603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:41 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:42.011899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:42.012527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:42.019055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.019586 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.020019 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:42.020765 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.021264 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.021697 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:42.158290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:42.166350 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f4235887-18d2-4115-8deb-65d867b746d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1730 microversion: 2.1 time: 0.159333 Aug 10 13:29:42.167445 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 298/604] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:42 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:42.188026 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:42.188759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:42.192325 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:42.195659 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.196144 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.196658 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:42.197446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.197911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.198576 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:42.203444 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:42.203957 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:42.210277 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.210970 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.213730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:42.213730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.213730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.213730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:42.298130 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e12db20b-8d96-4f98-a17f-61846783ffa7 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113860 Aug 10 13:29:42.298726 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 307/605] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 10 13:29:42 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:42.361023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:42.380429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:42.385174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:42.385174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8e2b883a-112f-46ca-9256-f8b8a7ee13c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1753 microversion: 2.20 time: 0.183865 Aug 10 13:29:42.385174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 299/606] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:42 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:42.660855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cc09d17-b492-4959-81c8-22dd226cc15a"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:42.666609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:42.673841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.674582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.675019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:42.676265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.676912 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.677371 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:42.974294 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:42.974928 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:42.996135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:42.996640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:42.997109 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:43.001310 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:43.001555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:43.002004 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:43.177575 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:43.197396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-32602920-f044-4c11-9530-f141d03a0b3e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.234620 Aug 10 13:29:43.199296 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 300/607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:42 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:43.408753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:43.409683 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:43.415660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:43.416158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:43.416733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:43.418694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:43.419165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:43.419599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:43.581815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:43.590842 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:43.592399 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:43.593800 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7a6fbcf6-930c-4a94-b557-880cd3845f65 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1753 microversion: 2.20 time: 0.188908 Aug 10 13:29:43.594670 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 301/608] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:43 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:43.737302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-44355f76-9a74-4a06-be58-df587a672c4a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "POST /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.080758 Aug 10 13:29:43.741051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 308/609] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:29:42 2022] POST /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 194 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:43.976204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-d9113611-b702-48f1-affb-e6b4988611d0 req-0387edd5-9e62-472f-9eb1-c0a40611c88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0788538-19b6-4d2b-ab3f-521dbd8cc729", "tag": "0687467f-3bdd-446f-8a4c-8b0ab78e9c63"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:43.991586 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-d9113611-b702-48f1-affb-e6b4988611d0 req-0387edd5-9e62-472f-9eb1-c0a40611c88a service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:43.992360 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-d9113611-b702-48f1-affb-e6b4988611d0 req-0387edd5-9e62-472f-9eb1-c0a40611c88a service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:43.992943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-d9113611-b702-48f1-affb-e6b4988611d0 req-0387edd5-9e62-472f-9eb1-c0a40611c88a service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:44.006784 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-d9113611-b702-48f1-affb-e6b4988611d0 req-0387edd5-9e62-472f-9eb1-c0a40611c88a service nova] Creating event network-changed:0687467f-3bdd-446f-8a4c-8b0ab78e9c63 for instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 on hv-cinder-83602 Aug 10 13:29:44.012381 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-d9113611-b702-48f1-affb-e6b4988611d0 req-0387edd5-9e62-472f-9eb1-c0a40611c88a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041446 Aug 10 13:29:44.012962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 302/610] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:44.220457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:44.221502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:44.228353 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:44.229334 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:44.230577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:44.232689 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:44.233412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:44.234163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:44.459187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:44.473350 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-96c6694b-c40b-423a-b3f9-9611d4053c3b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.256978 Aug 10 13:29:44.489727 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 309/611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:44 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:44.621541 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:44.622356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:44.630627 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:44.631134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:44.631579 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:44.632382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:44.632906 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:44.633290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:44.785710 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:44.796149 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:44.797746 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:44.798922 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-acb34fd6-d605-4efa-be02-7eef236446a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.185408 Aug 10 13:29:44.799478 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 303/612] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:44 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:45.498804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:45.499557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:45.506429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:45.506914 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:45.507348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:45.508050 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:45.508561 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:45.508932 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:45.749433 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:45.757553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ebfb605c-b6e3-4cb7-9032-db4db0939c18 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.263555 Aug 10 13:29:45.758431 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 310/613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:45 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:45.823537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:45.824441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:45.830655 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:45.831141 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:45.831573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:45.832257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:45.832891 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:45.833500 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:45.972300 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:45.984244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:45.985902 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:45.987074 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-22eca1da-6ca0-431e-9820-3d88052d09cc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.167622 Aug 10 13:29:45.987633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 304/614] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:45 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:46.027158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-279066ee-4adb-4917-9022-eaa19090c9e9 req-d2ed2946-fd2c-4c95-b151-351d505792c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0788538-19b6-4d2b-ab3f-521dbd8cc729", "tag": "0687467f-3bdd-446f-8a4c-8b0ab78e9c63"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:46.036883 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-279066ee-4adb-4917-9022-eaa19090c9e9 req-d2ed2946-fd2c-4c95-b151-351d505792c3 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:46.037449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-279066ee-4adb-4917-9022-eaa19090c9e9 req-d2ed2946-fd2c-4c95-b151-351d505792c3 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:46.037892 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-279066ee-4adb-4917-9022-eaa19090c9e9 req-d2ed2946-fd2c-4c95-b151-351d505792c3 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:46.049336 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-279066ee-4adb-4917-9022-eaa19090c9e9 req-d2ed2946-fd2c-4c95-b151-351d505792c3 service nova] Creating event network-changed:0687467f-3bdd-446f-8a4c-8b0ab78e9c63 for instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 on hv-cinder-83602 Aug 10 13:29:46.054161 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-279066ee-4adb-4917-9022-eaa19090c9e9 req-d2ed2946-fd2c-4c95-b151-351d505792c3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031178 Aug 10 13:29:46.054790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 311/615] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:46.779989 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:46.780914 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:46.793983 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:46.794730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:46.795628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:46.796518 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:46.797347 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:46.797925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:46.818476 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:47.009649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:47.011535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:47.012231 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:47.021463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-87dcc1b6-41ab-4d1f-a00e-dcf5b5344aa6 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.246928 Aug 10 13:29:47.022289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 305/616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:46 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:47.035055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:47.035746 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:47.036325 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:47.043194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:47.043194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:47.043194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:47.206268 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:47.217634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:47.219634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:47.221206 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8b28a95b-16fc-43e6-ac6a-aaf9f3d758a6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.214401 Aug 10 13:29:47.221993 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 312/617] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:47 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:48.048144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:48.049931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:48.059456 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:48.060254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:48.060914 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:48.061904 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:48.062606 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:48.063265 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:48.210537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:48.218866 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-86e5b74b-cad9-4908-9115-88b5b465dc60 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.175485 Aug 10 13:29:48.219435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 306/618] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:48 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:48.247007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:48.247608 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:48.254029 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:48.254499 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:48.254927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:48.255632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:48.256076 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:48.256484 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:48.398698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:48.418247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:48.419957 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:48.421262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-bc9ea49d-ab51-4564-a51e-b18eff849837 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.178502 Aug 10 13:29:48.421911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 313/619] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:48 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:49.240041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:49.241148 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:49.257332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:49.257835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:49.258277 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:49.258996 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:49.259457 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:49.259982 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:49.393077 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-b9f93ee0-1d4e-42f1-8408-388df4c20ef7 req-ecc33f13-3bad-4003-877e-68835e2cc8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c655ab7-4709-47e3-88ea-1841fa80d3fe", "name": "network-vif-plugged", "status": "completed", "tag": "4811b202-c18c-4dab-82bd-c56b9dcb0764"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:49.405125 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b9f93ee0-1d4e-42f1-8408-388df4c20ef7 req-ecc33f13-3bad-4003-877e-68835e2cc8f8 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:49.405840 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b9f93ee0-1d4e-42f1-8408-388df4c20ef7 req-ecc33f13-3bad-4003-877e-68835e2cc8f8 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:49.406261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b9f93ee0-1d4e-42f1-8408-388df4c20ef7 req-ecc33f13-3bad-4003-877e-68835e2cc8f8 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:49.416146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:49.426261 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7d28defb-9c9c-46b2-a237-f9ae4ff47024 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.190194 Aug 10 13:29:49.430521 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-b9f93ee0-1d4e-42f1-8408-388df4c20ef7 req-ecc33f13-3bad-4003-877e-68835e2cc8f8 service nova] Creating event network-vif-plugged:4811b202-c18c-4dab-82bd-c56b9dcb0764 for instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe on hv-cinder-83602 Aug 10 13:29:49.430660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 307/620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:49 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:49.440463 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-b9f93ee0-1d4e-42f1-8408-388df4c20ef7 req-ecc33f13-3bad-4003-877e-68835e2cc8f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051667 Aug 10 13:29:49.441096 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 314/621] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:29:49.449887 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:49.450746 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:49.456808 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:49.457330 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:49.457764 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:49.458658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:49.459119 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:49.459539 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:49.605327 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:49.614115 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:49.615633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:49.616802 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2b5f1cea-6f80-4ab5-be1c-1bf63accad0a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.171743 Aug 10 13:29:49.617395 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 308/622] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:49 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:50.445359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:50.450979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:50.451664 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:50.457665 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:50.459902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:50.459902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:50.459902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:50.459902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:50.460337 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:50.613654 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:50.622016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5e187931-8b06-43b2-9e24-db09e68fa96c tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.177771 Aug 10 13:29:50.622582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 315/623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:50 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:50.641833 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:50.647647 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:50.649035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:50.649527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:50.649959 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:50.650657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:50.651162 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:50.651681 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:50.796630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:50.806862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:50.809493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:50.810721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-68b70169-80fb-4eb0-a088-d8f3b8a031c1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.172786 Aug 10 13:29:50.811275 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 309/624] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:50 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:51.643306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:51.643909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:51.661236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:51.661236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:51.661236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:51.662937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:51.663855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:51.664313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:51.812424 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:51.820101 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6fb24329-0b39-4559-bdc1-aa218c8c94be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.180968 Aug 10 13:29:51.820673 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 316/625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:51 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:51.834308 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:51.835876 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:51.843148 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:51.843623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:51.844053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:51.844743 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:51.845387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:51.845831 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:51.982908 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:51.992438 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:51.994508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:51.996046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e2c07d81-3b71-4c44-9924-ac433264623d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.165614 Aug 10 13:29:51.996532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 310/626] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:51 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:52.843562 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:52.844154 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:52.850732 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:52.851225 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:52.851657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:52.852355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:52.852808 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:52.853257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:53.015580 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:53.024050 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4e6c6790-647b-4296-8645-bb11527c0f89 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.184289 Aug 10 13:29:53.029129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 317/627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:52 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:53.029260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:53.029260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:53.035566 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:53.036382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:53.037616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:53.038570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:53.039923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:53.040557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:53.216692 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:53.232108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:53.233952 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:53.235162 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-504a16d9-0561-4fe3-b368-0a86a9df53e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.219841 Aug 10 13:29:53.235722 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 311/628] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:53 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:29:54.049321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:54.053218 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:54.056690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:54.057978 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:54.058581 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:54.059620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:54.060304 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:54.060876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:54.244233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:54.263819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:54.264416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3f285d3e-79fb-49af-ae78-bb3b995c597f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.219245 Aug 10 13:29:54.265431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:54.277136 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:54.282426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 318/629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:54 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:54.282563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:54.282563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:54.282563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:54.282563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:54.282932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:54.495744 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:54.506978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:54.508616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:54.509907 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-91331c20-ec14-433f-afe4-6f8028ae8e4c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.253893 Aug 10 13:29:54.513038 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 312/630] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:54 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:55.286853 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:55.287756 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:55.295146 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:55.295736 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:55.296245 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:55.297052 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:55.297580 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:55.298071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:55.318986 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:55.442090 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:55.449960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-898e7173-afe1-4ea2-9332-0d6c40932fa7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.167325 Aug 10 13:29:55.450530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 319/631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:55 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:55.535862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:55.536564 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:55.543656 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:55.544218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:55.544725 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:55.545566 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:55.546175 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:55.546662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:55.695509 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:55.704570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:55.706101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:55.707255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9350f7ab-9ccd-413c-b03e-b4ea132106b6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.175762 Aug 10 13:29:55.707810 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 313/632] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:55 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:56.470759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:56.471296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:56.477693 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:56.478179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:56.478614 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:56.479299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:56.480273 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:56.480810 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:56.611863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:56.619285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ff9e01c0-94ab-4214-ad5a-9a9037af7f71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.152518 Aug 10 13:29:56.619851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 320/633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:56 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:56.732231 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:56.732914 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:56.739484 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:56.739964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:56.740395 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:56.745650 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:56.745650 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:56.745650 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:56.873576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:56.882002 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:56.883529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:56.884672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dba82a8f-d6b3-4a40-b2ed-c14d0ab92cee tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.157975 Aug 10 13:29:56.885348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 314/634] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:56 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:57.640506 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:57.641276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:57.647657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:57.648140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:57.648569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:57.649478 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:57.649938 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:57.651266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:57.782579 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:57.790234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-74e08ccc-9230-4af0-8aa3-c5df252a6d45 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.154387 Aug 10 13:29:57.790795 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 321/635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:57 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:57.908390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:57.908935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:57.915548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:57.916026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:57.916458 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:57.917179 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:57.917639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:57.918059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:58.048625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:58.056958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:58.059263 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:58.060494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8098dab8-38d6-4179-8872-6ed9a12d6e5c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.156038 Aug 10 13:29:58.061073 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 315/636] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:57 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:58.810524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:58.811133 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:58.817798 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:58.818282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:58.818712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:58.819394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:58.819855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:58.820306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:58.875756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:58.876607 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:58.882646 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:58.883240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:58.883765 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:58.884529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:58.885076 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:58.885572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:58.960459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:58.968610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1eb1dbff-73e0-4416-ad7d-c0905a7f897f tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1366 microversion: 2.1 time: 0.162420 Aug 10 13:29:58.973012 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 322/637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:58 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:29:59.024164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:59.032539 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-37e8b7d8-5d38-4e73-a714-14d6cebae947 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1593 microversion: 2.1 time: 0.160722 Aug 10 13:29:59.033166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 316/638] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:58 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1593 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:59.085111 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:59.085679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:29:59.092359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:59.092853 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:59.093475 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:59.094171 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:59.094633 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:59.095057 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:59.227296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:59.236441 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:59.238172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:29:59.239339 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-de65e149-ae4f-44cb-86dc-48a26607e2c0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.159363 Aug 10 13:29:59.239930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 323/639] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:29:59 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:29:59.990100 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:59.990723 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:00.002576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:00.003196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:00.003561 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:00.004284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:00.004740 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:00.005198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:00.262627 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:00.263238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:00.270327 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:00.270833 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:00.271266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:00.271956 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:00.272408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:00.272827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:00.323411 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:00.331704 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c99b2f00-1867-4d9d-ba13-c8562901d08e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1556 microversion: 2.1 time: 0.345564 Aug 10 13:30:00.332400 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 317/640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:29:59 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1556 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:00.357220 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:00.358013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:00.366978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:00.367677 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:00.368235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:00.369161 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:00.369729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:00.370252 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:00.418033 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:00.426649 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:00.428224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:00.429450 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e1a7555c-cc01-4aa9-aeca-aa57984b33d8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.171458 Aug 10 13:30:00.430013 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 324/641] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:00 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:30:00.463491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a9e6de9f-c91f-4489-b582-937af29bf279 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111399 Aug 10 13:30:00.464243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 318/642] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 10 13:30:00 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:30:01.453137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:01.453745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:01.460171 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:01.460653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:01.461119 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:01.461805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:01.462262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:01.462686 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:01.594259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:01.602721 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:01.604236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:01.605942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-98a6e34f-26cd-45ea-aa70-df2db6d35938 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.156929 Aug 10 13:30:01.606491 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 325/643] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:01 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:02.196770 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-1137fdcd-a8c4-4b49-9fa5-1c4a1d24a76a req-3a09ea41-43a5-41a1-8f80-8b8468f1fb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c04cd31-0203-46ab-bee8-1cdaf27c3e34", "tag": "273e8b95-1ed6-4f94-a5b2-d256242f35e1"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:02.215885 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1137fdcd-a8c4-4b49-9fa5-1c4a1d24a76a req-3a09ea41-43a5-41a1-8f80-8b8468f1fb4c service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:02.216367 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1137fdcd-a8c4-4b49-9fa5-1c4a1d24a76a req-3a09ea41-43a5-41a1-8f80-8b8468f1fb4c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:02.216802 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-1137fdcd-a8c4-4b49-9fa5-1c4a1d24a76a req-3a09ea41-43a5-41a1-8f80-8b8468f1fb4c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:02.239088 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-1137fdcd-a8c4-4b49-9fa5-1c4a1d24a76a req-3a09ea41-43a5-41a1-8f80-8b8468f1fb4c service nova] Creating event network-changed:273e8b95-1ed6-4f94-a5b2-d256242f35e1 for instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 on hv-cinder-83602 Aug 10 13:30:02.244788 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-1137fdcd-a8c4-4b49-9fa5-1c4a1d24a76a req-3a09ea41-43a5-41a1-8f80-8b8468f1fb4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052318 Aug 10 13:30:02.246962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 319/644] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:02.631349 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:02.636094 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:02.639476 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:02.640332 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:02.641155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:02.642081 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:02.642814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:02.643452 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:02.887333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:02.900731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:02.903831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:02.905569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0b409a6f-0e69-459f-97a6-b9ee9ecef311 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.278892 Aug 10 13:30:02.907230 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 326/645] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:02 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:03.931451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:03.932302 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:03.939184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:03.939675 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:03.940286 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:03.940829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:03.941312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:03.941768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:04.078192 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:04.086700 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:04.088223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:04.090004 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-231088ad-7d07-495b-ad32-9c1220700b8d tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.163316 Aug 10 13:30:04.090565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 320/646] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:03 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:04.260812 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-72f56be6-122a-4542-b553-855d757e204c req-a55c9fd6-95a3-4a0a-86af-3e31cd443e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c655ab7-4709-47e3-88ea-1841fa80d3fe", "tag": "4811b202-c18c-4dab-82bd-c56b9dcb0764"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:04.271604 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-72f56be6-122a-4542-b553-855d757e204c req-a55c9fd6-95a3-4a0a-86af-3e31cd443e30 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:04.272074 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-72f56be6-122a-4542-b553-855d757e204c req-a55c9fd6-95a3-4a0a-86af-3e31cd443e30 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:04.272495 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-72f56be6-122a-4542-b553-855d757e204c req-a55c9fd6-95a3-4a0a-86af-3e31cd443e30 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:04.285751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-72f56be6-122a-4542-b553-855d757e204c req-a55c9fd6-95a3-4a0a-86af-3e31cd443e30 service nova] Creating event network-changed:4811b202-c18c-4dab-82bd-c56b9dcb0764 for instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe on hv-cinder-83602 Aug 10 13:30:04.300397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-72f56be6-122a-4542-b553-855d757e204c req-a55c9fd6-95a3-4a0a-86af-3e31cd443e30 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034395 Aug 10 13:30:04.300397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 327/647] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:04.609835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1696493206"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:04.610376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:04.616464 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:04.616956 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:04.617423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:04.618334 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:04.618789 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:04.619211 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:04.760948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.network.security_group_api [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Adding security group d80b23fc-9246-4241-a31d-3b97783b2e10 to port 273e8b95-1ed6-4f94-a5b2-d256242f35e1 Aug 10 13:30:05.114858 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:05.115679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:05.122825 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:05.123482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:05.124053 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:05.124871 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:05.125587 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:05.126076 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:05.130429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-34d8306b-f20b-440b-80f0-c5ae6b3f5732 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "POST /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/action" status: 202 len: 0 microversion: 2.1 time: 0.524170 Aug 10 13:30:05.135624 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 321/648] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:30:04 2022] POST /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:30:05.142134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:05.143028 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:05.150886 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:05.151891 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:05.152808 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:05.153711 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:05.154384 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:05.154962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:05.290732 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:05.301050 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:05.302889 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:05.305003 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-285857a6-1fff-4a14-9827-0d7039f29254 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.194577 Aug 10 13:30:05.305659 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 328/649] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:05 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:30:05.335831 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:05.345121 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-84c0cf7b-01fd-42d9-bdbf-b1d8788ae7e5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1759 microversion: 2.1 time: 0.208081 Aug 10 13:30:05.348315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 322/650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:05 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1759 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:06.309400 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-46f6a364-78a5-4a21-9562-e91a6fdedc78 req-3607aa4c-49dd-474c-8029-ad7d61ced94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c04cd31-0203-46ab-bee8-1cdaf27c3e34", "tag": "273e8b95-1ed6-4f94-a5b2-d256242f35e1"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:06.319024 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-46f6a364-78a5-4a21-9562-e91a6fdedc78 req-3607aa4c-49dd-474c-8029-ad7d61ced94c service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:06.319492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-46f6a364-78a5-4a21-9562-e91a6fdedc78 req-3607aa4c-49dd-474c-8029-ad7d61ced94c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:06.319915 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-46f6a364-78a5-4a21-9562-e91a6fdedc78 req-3607aa4c-49dd-474c-8029-ad7d61ced94c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:06.330821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:06.331432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:06.331563 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-46f6a364-78a5-4a21-9562-e91a6fdedc78 req-3607aa4c-49dd-474c-8029-ad7d61ced94c service nova] Creating event network-changed:273e8b95-1ed6-4f94-a5b2-d256242f35e1 for instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 on hv-cinder-83602 Aug 10 13:30:06.336152 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-46f6a364-78a5-4a21-9562-e91a6fdedc78 req-3607aa4c-49dd-474c-8029-ad7d61ced94c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031354 Aug 10 13:30:06.336903 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 329/651] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:06.339189 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:06.339523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:06.339952 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:06.340640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:06.341111 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:06.341531 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:06.361971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:06.482936 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:06.492188 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:06.493994 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:06.495681 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-491d75c3-b567-495c-8b73-8edef1206bf4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.168328 Aug 10 13:30:06.496504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 323/652] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:06 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:06.643468 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-b4d92b66-88ba-42bc-b1dc-df3bdb3443fb req-258e49e8-ef42-4ac4-bdf3-9b5c52dbbd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88fd6a8-9262-4f5c-9b91-ed4e70704cb9", "name": "network-vif-plugged", "status": "completed", "tag": "ea8828a3-61d3-4d2e-9d76-db0b898a6fd4"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:06.654067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b4d92b66-88ba-42bc-b1dc-df3bdb3443fb req-258e49e8-ef42-4ac4-bdf3-9b5c52dbbd77 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:06.654828 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b4d92b66-88ba-42bc-b1dc-df3bdb3443fb req-258e49e8-ef42-4ac4-bdf3-9b5c52dbbd77 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:06.655411 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b4d92b66-88ba-42bc-b1dc-df3bdb3443fb req-258e49e8-ef42-4ac4-bdf3-9b5c52dbbd77 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:06.668390 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-b4d92b66-88ba-42bc-b1dc-df3bdb3443fb req-258e49e8-ef42-4ac4-bdf3-9b5c52dbbd77 service nova] Creating event network-vif-plugged:ea8828a3-61d3-4d2e-9d76-db0b898a6fd4 for instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 on hv-cinder-83602 Aug 10 13:30:06.673217 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-b4d92b66-88ba-42bc-b1dc-df3bdb3443fb req-258e49e8-ef42-4ac4-bdf3-9b5c52dbbd77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Aug 10 13:30:06.673832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 330/653] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:07.518610 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:07.519220 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:07.525697 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:07.526180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:07.527250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:07.527944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:07.528400 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:07.528826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:07.662270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:07.670958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:07.672466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:07.673649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-07f61ff3-9e93-469d-b27f-a81d36059d7c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.159041 Aug 10 13:30:07.674212 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 324/654] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:07 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:08.697005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:08.697719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:08.704116 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:08.704605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:08.705064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:08.705773 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:08.706236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:08.706695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:08.843124 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:08.851952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:08.853017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:08.854212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8a497292-ed9a-4da6-b4d8-b748453515b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.161996 Aug 10 13:30:08.855419 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 331/655] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:08 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:09.879722 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:09.880335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:09.887951 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:09.888503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:09.888920 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:09.889649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:09.890109 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:09.890542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:10.021350 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:10.029947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:10.031502 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:10.032657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-35111c14-d481-4002-9deb-0753f1bf2ef8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1809 microversion: 2.20 time: 0.156953 Aug 10 13:30:10.033245 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 325/656] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:09 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:10.743197 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:10.746205 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:10.752699 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:10.753437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:10.753876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:10.754577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:10.755033 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:10.755485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:10.784230 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-99a05097-14a5-4ddc-abb3-6011e56bc00b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044979 Aug 10 13:30:10.785072 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 332/657] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:30:10 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 13:30:10.848823 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:10.849362 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:10.851260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=60 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:10.856145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:10.860049 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:10.860049 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:10.860049 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:10.860049 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:10.860424 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:10.886436 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:30:11.055663 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:11.056267 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:11.062777 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:11.063258 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:11.063691 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:11.064381 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:11.064837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:11.065299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:11.130725 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b9e49252-a3de-4482-8df4-d05979b60114 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 204 len: 0 microversion: 2.1 time: 0.285484 Aug 10 13:30:11.131377 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 326/658] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:30:10 2022] DELETE /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:30:11.141428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:11.142193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:11.148484 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:11.148964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:11.149428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:11.150122 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:11.150570 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:11.150992 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:11.197991 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:11.206623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:11.208130 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:11.209660 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0719ba50-fbfe-4966-9dcb-4b44f301f0c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1796 microversion: 2.20 time: 0.157861 Aug 10 13:30:11.210226 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 333/659] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:11 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1796 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:30:11.283587 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:11.291357 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7cc872b1-cf50-4bd4-86de-d1b8978973d8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1671 microversion: 2.1 time: 0.155286 Aug 10 13:30:11.292427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 327/660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:11 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:12.313724 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:12.314692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:12.321739 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:12.322254 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:12.322696 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:12.323436 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:12.323849 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:12.324374 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:12.474191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:12.483673 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-699f5ddd-c93a-46b8-8cbc-a3f281c51d5c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1671 microversion: 2.1 time: 0.173774 Aug 10 13:30:12.484351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 334/661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:12 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:13.505812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:13.506343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:13.513544 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:13.514023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:13.514452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:13.515194 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:13.515582 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:13.515999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:13.656038 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:13.664428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2641c3c6-9357-4482-8f35-fa90d598f8f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1671 microversion: 2.1 time: 0.162754 Aug 10 13:30:13.665106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 328/662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:13 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:14.255879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-ba329a31-7834-42c5-b304-09bc7a3eba16 req-be270d7c-2142-41f6-a75f-ce0566e93faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280", "name": "network-vif-deleted", "tag": "5bf722b9-3a94-4cb8-b29c-ff395567c59a"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:14.262514 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=55 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:14.268231 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ba329a31-7834-42c5-b304-09bc7a3eba16 req-be270d7c-2142-41f6-a75f-ce0566e93faf service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:14.268713 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ba329a31-7834-42c5-b304-09bc7a3eba16 req-be270d7c-2142-41f6-a75f-ce0566e93faf service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:14.269183 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ba329a31-7834-42c5-b304-09bc7a3eba16 req-be270d7c-2142-41f6-a75f-ce0566e93faf service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:14.282044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-ba329a31-7834-42c5-b304-09bc7a3eba16 req-be270d7c-2142-41f6-a75f-ce0566e93faf service nova] Creating event network-vif-deleted:5bf722b9-3a94-4cb8-b29c-ff395567c59a for instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 on hv-cinder-83602 Aug 10 13:30:14.287212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-ba329a31-7834-42c5-b304-09bc7a3eba16 req-be270d7c-2142-41f6-a75f-ce0566e93faf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035217 Aug 10 13:30:14.287826 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 335/663] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:14.686574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:14.687316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:14.693993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:14.694557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:14.695064 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:14.695862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:14.696390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:14.696885 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:14.729259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:14.729741 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:14.730178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:14.730818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lazy-loading 'fault' on Instance uuid 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:30:14.772074 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:14.779602 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5d27bce2-a4f5-4b9b-9c95-f6fc13096ecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 200 len: 1325 microversion: 2.1 time: 0.097612 Aug 10 13:30:14.780180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 329/664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:14 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:15.801088 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:15.801777 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:15.808306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:15.809309 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:15.809435 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:15.810101 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:15.810551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:15.810974 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:15.823947 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] HTTP exception thrown: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Request method failure captured: Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 HTTP/1.1 Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HHxRul-kcZfukl7Vlopibkt-oH6ume0jKmZHoGxJaW4-Np6O2qjVmJeXy_5Of51BFkQqLE4BrVrV0hJXYjQd2f1v9D7ZcRy4SVDd_G3-_A4GOmNEw706QWjSbv41_swnvOnWjrti6xPX-IzfTFEiwX8jCra9tPVOAktgx0pntOAVA Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:30:15.826138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3070abbdec34c779d4bd382b2bb1697", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 0ace2374550e40ce812407406c262ac5 Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:30:15.827695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280'} Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:15.828577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:30:15.830107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:15.831567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Returning 404 to user: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:15.831567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-39b33dda-1fa6-4ea6-ac6f-af5fedc59775 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 404 len: 111 microversion: 2.1 time: 0.031493 Aug 10 13:30:15.831567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 336/665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:15 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:30:15.836318 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-75467117-13d6-4f56-bfef-b16d40bfaecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '.version_select at 0x7ff6a37d2e50>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:15.914341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-75467117-13d6-4f56-bfef-b16d40bfaecd tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498883142" status: 202 len: 0 microversion: 2.1 time: 0.081755 Aug 10 13:30:15.914862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 330/666] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 10 13:30:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498883142 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:30:16.658831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-eed1ffe8-5a37-4cf5-9b8c-000a8bf8159c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'create', calling method: .version_select at 0x7ff6a372d040>, body: {"keypair": {"name": "tempest-keypair-124246939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvP0ocPkB+ErBQGTkQL4CNBpTNlnlwAKn6h8fQHf0BDp1Ae8Lmj1zkQ5O4FBMKFJN2LcJmmXcgeeHJ+2lwdWTW9DEI+gHB7ocNxUkMorBV0EtRrPWIj2zGoBwtW+6tVaA=="}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:16.674748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-eed1ffe8-5a37-4cf5-9b8c-000a8bf8159c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Getting quotas for project f3070abbdec34c779d4bd382b2bb1697. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:30:16.678559 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-eed1ffe8-5a37-4cf5-9b8c-000a8bf8159c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Getting quotas for user 0ace2374550e40ce812407406c262ac5 and project f3070abbdec34c779d4bd382b2bb1697. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:30:16.766093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-eed1ffe8-5a37-4cf5-9b8c-000a8bf8159c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111275 Aug 10 13:30:16.766692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 337/667] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:30:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:19.238804 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-915375989", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f63fe725-8584-424d-903e-f50b1efc4f3a"}], "security_groups": [{"name": "tempest-securitygroup--566014814"}], "key_name": "tempest-keypair-124246939", "user_data": "}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:19.501833 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] validate_networks() for [('f63fe725-8584-424d-903e-f50b1efc4f3a', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:30:19.920186 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:30:19.920606 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:30:19.921107 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:30:19.921640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:30:19.922051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:30:19.931004 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:19.931475 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:19.932044 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:19.932765 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:19.933311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:19.933747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:19.951076 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Getting quotas for project f3070abbdec34c779d4bd382b2bb1697. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:30:19.955187 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Getting quotas for user 0ace2374550e40ce812407406c262ac5 and project f3070abbdec34c779d4bd382b2bb1697. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:30:19.975043 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:30:19.978503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:30:20.140413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2bec6a9b-7ce8-49ca-a750-447fe7727c61 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.905853 Aug 10 13:30:20.141027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 331/668] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:30:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:30:20.153857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0452be54-895b-4bc2-aa6f-108a4e86958e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:20.154799 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0452be54-895b-4bc2-aa6f-108a4e86958e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:20.283045 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0452be54-895b-4bc2-aa6f-108a4e86958e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:20.293431 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0452be54-895b-4bc2-aa6f-108a4e86958e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1236 microversion: 2.1 time: 0.145226 Aug 10 13:30:20.294340 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 338/669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:20 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1236 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:21.315808 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:21.316451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:21.322987 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:21.323463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:21.323989 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:21.324837 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:21.325329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:21.325809 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:21.390874 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:21.398329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fc07debd-3c8f-40ba-bcf4-f5cbc086ef47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1232 microversion: 2.1 time: 0.086484 Aug 10 13:30:21.398888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 332/670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:21 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1232 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:22.420101 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:22.420713 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:22.427377 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:22.427862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:22.428306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:22.429016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:22.429477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:22.429904 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:22.500771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:22.508187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-49d2da5b-e9c9-400c-ad59-616126333b8b tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1294 microversion: 2.1 time: 0.092321 Aug 10 13:30:22.508745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 339/671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:22 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:23.536452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:23.537682 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:23.546394 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:23.546894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:23.547340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:23.548053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:23.548757 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:23.549427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:23.689344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:23.697218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0ef85ddd-ef32-41fd-838a-2cb16db723a6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.165282 Aug 10 13:30:23.697787 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 333/672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:23 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:23.719765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-d4a2218b-ca28-450f-8f69-9c53d67fafc1 req-e6bd56f3-2ce1-4abb-bac5-d4e2449c3e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2690bd0-5fca-4960-b86c-ca587fd564ec", "tag": "f68047cb-8eb7-4646-831d-ac7ecea60a98"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:23.731938 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d4a2218b-ca28-450f-8f69-9c53d67fafc1 req-e6bd56f3-2ce1-4abb-bac5-d4e2449c3e5e service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:23.732456 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d4a2218b-ca28-450f-8f69-9c53d67fafc1 req-e6bd56f3-2ce1-4abb-bac5-d4e2449c3e5e service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:23.732888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d4a2218b-ca28-450f-8f69-9c53d67fafc1 req-e6bd56f3-2ce1-4abb-bac5-d4e2449c3e5e service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:23.744575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-d4a2218b-ca28-450f-8f69-9c53d67fafc1 req-e6bd56f3-2ce1-4abb-bac5-d4e2449c3e5e service nova] Creating event network-changed:f68047cb-8eb7-4646-831d-ac7ecea60a98 for instance d2690bd0-5fca-4960-b86c-ca587fd564ec on hv-cinder-83602 Aug 10 13:30:23.750531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-d4a2218b-ca28-450f-8f69-9c53d67fafc1 req-e6bd56f3-2ce1-4abb-bac5-d4e2449c3e5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036708 Aug 10 13:30:23.752068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 340/673] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:24.719332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:24.719953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:24.726441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:24.726934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:24.727382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:24.728075 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:24.728529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:24.728958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:24.861429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:24.868657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b349073b-2af0-4f27-8cea-5b222b1174c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.154915 Aug 10 13:30:24.869256 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 334/674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:24 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:24.871853 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:24.872459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:24.879130 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:24.879613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:24.880049 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:24.880740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:24.881222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:24.881647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:25.007370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lazy-loading 'services' on Instance uuid e0788538-19b6-4d2b-ab3f-521dbd8cc729 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:30:25.043117 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=100 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:25.262585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-061c73a2-b20d-49da-a2e9-e4ac26039e38 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments/b8b935f4-bdc8-4a66-b020-e3cd2fc0e92a" status: 202 len: 0 microversion: 2.1 time: 0.393805 Aug 10 13:30:25.263188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 341/675] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:30:24 2022] DELETE /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments/b8b935f4-bdc8-4a66-b020-e3cd2fc0e92a => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:30:25.271698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:25.274124 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:25.280472 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:25.280956 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:25.281429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:25.282139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:25.282658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:25.283084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:25.312686 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-85507b25-bc76-49ac-8760-dec3c8b809d1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Aug 10 13:30:25.313171 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 335/676] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:30:25 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:25.890992 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:25.891681 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:25.897666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:25.898149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:25.898581 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:25.899266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:25.899718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:25.900132 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:25.961756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:25.964263 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:25.971135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:25.974210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:25.974210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:25.974210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:25.974210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:25.974554 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:26.037548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:26.045492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5b82acd1-8a9f-43dd-95fd-8d4ce2ca24f6 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.159837 Aug 10 13:30:26.047911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 342/677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:25 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:26.163248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3613c971-e0ce-49d2-9605-7a8673430748 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "POST /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/action" status: 202 len: 0 microversion: 2.1 time: 0.205387 Aug 10 13:30:26.163884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 336/678] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:30:25 2022] POST /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:30:26.174129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:26.174129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:26.178976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:26.179461 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:26.179897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:26.180590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:26.181073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:26.181504 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:26.328021 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:26.330633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:26.337334 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:26.343845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:26.343845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:26.343845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:26.343845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:26.344542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:26.373053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-25a53f15-c25d-4744-8d37-010fbd6ae16a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051285 Aug 10 13:30:26.373737 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 337/679] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:30:26 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:26.400200 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:26.408804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-cc72a5f5-abbb-4906-adca-09675b60c9fc tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1751 microversion: 2.1 time: 0.240207 Aug 10 13:30:26.409683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 343/680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:26 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:27.066884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:27.067650 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:27.075228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.075724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.076158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.077138 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.077614 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.078048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.230819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:27.234562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:27.238875 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1aadcae9-f427-46a4-95e5-d40fc0c5b409 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.175945 Aug 10 13:30:27.243944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 338/681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:27 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:27.385547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:27.387855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:27.394184 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.394659 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.395087 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.395774 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.396223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.396641 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.425815 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-48acb8ae-4e2e-4790-951e-02bab4816d0c tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044386 Aug 10 13:30:27.426362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 344/682] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:30:27 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:30:27.435490 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:27.436175 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:27.443028 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.443585 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.444027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.444721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.445208 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.445628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.513184 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:27.513697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:27.520518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.521064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.521512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.522454 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.522913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.523368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.553423 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:30:27.592538 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:27.600432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3e4ca0c1-9f82-474b-b44c-206a87050954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.169239 Aug 10 13:30:27.601069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 339/683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:27 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:27.862335 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b45eb94a-d186-4155-b486-9e9d695509a0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 204 len: 0 microversion: 2.1 time: 0.353127 Aug 10 13:30:27.862936 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 345/684] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:30:27 2022] DELETE /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:30:27.871838 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:27.872439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:27.878401 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.878881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.879310 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:27.879990 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:27.880435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:27.880851 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:28.014057 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:28.021547 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-eeb16b55-3106-4cf4-9769-ba7a7bf09ecf tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1690 microversion: 2.1 time: 0.154260 Aug 10 13:30:28.022114 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 340/685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:27 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:28.260530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:28.261453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:28.267407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:28.267887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:28.268319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:28.269039 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:28.269472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:28.269890 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:28.399584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:28.407755 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d85e14b7-4e49-4c9a-aa89-4e63336e7649 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.151662 Aug 10 13:30:28.408320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 346/686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:28 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:28.622701 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:28.623324 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:28.629906 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:28.630389 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:28.630825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:28.631523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:28.631979 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:28.632402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:28.781158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:28.789627 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e5952940-1b4b-4477-98a7-d7b6cbe0fe44 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.170913 Aug 10 13:30:28.790382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 341/687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:28 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:28.823404 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-7b87717c-613f-479f-9c7a-a4f7226b4927 req-55e8f1f6-6654-4c62-93c2-01804b88e4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2690bd0-5fca-4960-b86c-ca587fd564ec", "name": "network-vif-plugged", "status": "completed", "tag": "f68047cb-8eb7-4646-831d-ac7ecea60a98"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:28.833457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7b87717c-613f-479f-9c7a-a4f7226b4927 req-55e8f1f6-6654-4c62-93c2-01804b88e4c0 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:28.833935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7b87717c-613f-479f-9c7a-a4f7226b4927 req-55e8f1f6-6654-4c62-93c2-01804b88e4c0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:28.834367 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-7b87717c-613f-479f-9c7a-a4f7226b4927 req-55e8f1f6-6654-4c62-93c2-01804b88e4c0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:28.845159 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-7b87717c-613f-479f-9c7a-a4f7226b4927 req-55e8f1f6-6654-4c62-93c2-01804b88e4c0 service nova] Creating event network-vif-plugged:f68047cb-8eb7-4646-831d-ac7ecea60a98 for instance d2690bd0-5fca-4960-b86c-ca587fd564ec on hv-cinder-83602 Aug 10 13:30:28.849858 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-7b87717c-613f-479f-9c7a-a4f7226b4927 req-55e8f1f6-6654-4c62-93c2-01804b88e4c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030217 Aug 10 13:30:28.850430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 347/688] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:29.042950 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:29.043562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:29.049822 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:29.050311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:29.050747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:29.051439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:29.051896 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:29.052321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:29.185335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:29.192714 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-80010f1f-d52d-4c30-8e63-7b36ae23679d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1690 microversion: 2.1 time: 0.153627 Aug 10 13:30:29.193326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 342/689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:29 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:29.487588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:29.488291 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:29.494428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:29.494918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:29.495856 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:29.496558 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:29.497049 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:29.497485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:29.628190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:29.635613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-79ee9895-d6f5-4459-8609-be0f47de5275 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.210906 Aug 10 13:30:29.636195 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 348/690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:29 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:29.811038 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:29.811646 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:29.817945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:29.818416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:29.818843 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:29.819564 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:29.820008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:29.820425 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:29.941290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:29.960630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:29.962771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:29.970839 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-98fc9c56-55ef-4238-8396-b6e80b56108b tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.163708 Aug 10 13:30:29.971408 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 343/691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:29 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:30.290223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=6 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:30.311307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:30.311910 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:30.317974 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:30.318452 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:30.318881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:30.319573 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:30.320010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:30.320430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:30.452924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:30.460500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-90559e9d-f6ae-4a14-8861-492b7ad08749 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1690 microversion: 2.1 time: 0.250232 Aug 10 13:30:30.461080 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 349/692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:30 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1690 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:30.656437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:30.659003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:30.663744 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:30.664232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:30.664670 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:30.665436 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:30.665902 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:30.666331 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:30.801815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:30.810880 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3680dac2-92a7-4bbf-b41c-b8a095b10158 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.159018 Aug 10 13:30:30.813458 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 344/693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:30 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:30.992254 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:30.992776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:30.998956 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:30.999480 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:30.999897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:31.000577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:31.001043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:31.001466 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:31.141760 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:31.149551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1b6687f5-0605-4187-8ff1-04a3ab4513f2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.161265 Aug 10 13:30:31.150107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 350/694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:30 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:31.481573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:31.482178 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:31.488542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:31.489056 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:31.489499 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:31.490197 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:31.490655 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:31.491083 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:31.621286 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:31.628721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e75bd123-5fa3-488a-baa9-50013d6bda5d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1690 microversion: 2.1 time: 0.151071 Aug 10 13:30:31.629334 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 345/695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:31 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:31.832093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:31.832679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:31.839175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:31.839663 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:31.840101 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:31.840789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:31.841272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:31.841697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:32.031667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:32.039283 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7b0a0a19-56e9-4276-b848-ba5e03a12639 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.211133 Aug 10 13:30:32.039965 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 351/696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:31 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:32.171915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:32.172975 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:32.179212 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:32.179695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:32.180132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:32.180828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:32.181312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:32.181739 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:32.328007 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:32.335987 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ee7d0e80-9036-4394-96e6-1fdceb0677d4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.168584 Aug 10 13:30:32.336563 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 346/697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:32 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:32.649416 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:32.650023 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:32.657648 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:32.658137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:32.658724 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:32.659785 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:32.660236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:32.660660 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:32.877522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:32.885158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7e72c25c-5db1-44c8-816b-9f14170d60c9 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1690 microversion: 2.1 time: 0.239476 Aug 10 13:30:32.885769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 352/698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:32 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1690 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:33.061443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:33.061975 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:33.068829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.069365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.069806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.070506 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.070952 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.071372 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.230446 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:33.238923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7c6655f2-c410-466e-b756-956cd43d3011 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1361 microversion: 2.1 time: 0.182441 Aug 10 13:30:33.239520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 347/699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:33 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:33.353079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-70d0e1db-160a-4620-b4e9-bd5fde41184f req-915d04d0-9152-4d7b-848d-3c1a8bf66d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0788538-19b6-4d2b-ab3f-521dbd8cc729", "name": "network-vif-deleted", "tag": "0687467f-3bdd-446f-8a4c-8b0ab78e9c63"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:33.356944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:33.357592 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:33.365015 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.365513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.365928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-70d0e1db-160a-4620-b4e9-bd5fde41184f req-915d04d0-9152-4d7b-848d-3c1a8bf66d9f service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.366076 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.366419 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-70d0e1db-160a-4620-b4e9-bd5fde41184f req-915d04d0-9152-4d7b-848d-3c1a8bf66d9f service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.366649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.366849 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-70d0e1db-160a-4620-b4e9-bd5fde41184f req-915d04d0-9152-4d7b-848d-3c1a8bf66d9f service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.367109 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.367540 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.380676 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-70d0e1db-160a-4620-b4e9-bd5fde41184f req-915d04d0-9152-4d7b-848d-3c1a8bf66d9f service nova] Creating event network-vif-deleted:0687467f-3bdd-446f-8a4c-8b0ab78e9c63 for instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 on hv-cinder-83602 Aug 10 13:30:33.385505 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-70d0e1db-160a-4620-b4e9-bd5fde41184f req-915d04d0-9152-4d7b-848d-3c1a8bf66d9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036173 Aug 10 13:30:33.386734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 353/700] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:33.523562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:33.531876 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a99ab414-3632-40ed-923f-7001aa2bd954 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.178974 Aug 10 13:30:33.532551 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 348/701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:33 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:33.908332 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:33.908941 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:33.915262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.915735 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.916169 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.916849 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.917547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.918036 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.985983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:33.994167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f3b67a81-eecc-44a5-a200-e5e4ba6b6cf6 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 200 len: 1331 microversion: 2.1 time: 0.090497 Aug 10 13:30:33.994758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 354/702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:33 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:34.259855 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:34.260979 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:34.267341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:34.267824 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:34.268267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:34.268985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:34.269452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:34.269872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:34.404809 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:34.413190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-463ac782-301f-453d-8fa7-6581e8f61d5f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1547 microversion: 2.1 time: 0.157311 Aug 10 13:30:34.413759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 349/703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:34 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:34.438278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:34.438809 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:34.444657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:34.445197 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:34.445628 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:34.446305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:34.446753 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:34.447169 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:34.528063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-43d5f31f-fb5f-43ef-93a7-61ecacf3ed0c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093207 Aug 10 13:30:34.528864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 355/704] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 10 13:30:34 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:34.553767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:34.554387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:34.560822 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:34.561382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:34.561819 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:34.562518 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:34.562977 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:34.563406 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:34.841332 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:34.849450 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c8860ba6-c757-4a2e-ad80-fad134c46147 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.299597 Aug 10 13:30:34.850020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 350/705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:34 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:35.016502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:35.017242 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: e0788538-19b6-4d2b-ab3f-521dbd8cc729] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:35.023165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:35.023647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:35.024083 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:35.024771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:35.025248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:35.025700 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:35.040054 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] HTTP exception thrown: Instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 could not be found. Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Request method failure captured: Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 HTTP/1.1 Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HI8d6dqhS5K-ZbrX184FWe_fKIHc4FnlHdDzwnLTq8-Y3JD5vSjoVyD0ZRKwi7HBpcs2JMi38-2hM5ZGw9WCKfkOWYwVBtjiwW4NDea0c2b5B7VAoskt-n6HGpwWC7Ob_NVt3sYHk6M9GNnMMsYUc7WWG-Zoyju8lMuZrQ63R0c1s Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:30:35.041752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0c9fae66a6f4ac9a0c1b0629e597906", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 4dfd3ee79da943b189824630b5c393ee Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 could not be found. Aug 10 13:30:35.044093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'e0788538-19b6-4d2b-ab3f-521dbd8cc729'} Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 could not be found. Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:35.049960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 could not be found. Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 could not be found. Aug 10 13:30:35.051638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:35.052923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Returning 404 to user: Instance e0788538-19b6-4d2b-ab3f-521dbd8cc729 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:35.052923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6a75716d-bbdd-4e52-a5b4-815520d398ee tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729" status: 404 len: 111 microversion: 2.1 time: 0.031944 Aug 10 13:30:35.052923 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 356/706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:35 2022] GET /compute/v2.1/servers/e0788538-19b6-4d2b-ab3f-521dbd8cc729 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:30:35.053209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a01028aa-0e9b-4cab-9d8e-551f40445ba0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '.version_select at 0x7ff6a37ae0d0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:35.126108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a01028aa-0e9b-4cab-9d8e-551f40445ba0 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804757345" status: 202 len: 0 microversion: 2.1 time: 0.077372 Aug 10 13:30:35.129704 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 351/707] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Aug 10 13:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804757345 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:30:35.715925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-803c9ad8-e3de-45ca-818a-05f7789c4ed2 req-9a877a38-d0bf-43b0-a989-123981c97b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2690bd0-5fca-4960-b86c-ca587fd564ec", "tag": "f68047cb-8eb7-4646-831d-ac7ecea60a98"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:35.727031 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-803c9ad8-e3de-45ca-818a-05f7789c4ed2 req-9a877a38-d0bf-43b0-a989-123981c97b50 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:35.727796 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-803c9ad8-e3de-45ca-818a-05f7789c4ed2 req-9a877a38-d0bf-43b0-a989-123981c97b50 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:35.728394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-803c9ad8-e3de-45ca-818a-05f7789c4ed2 req-9a877a38-d0bf-43b0-a989-123981c97b50 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:35.740855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-803c9ad8-e3de-45ca-818a-05f7789c4ed2 req-9a877a38-d0bf-43b0-a989-123981c97b50 service nova] Creating event network-changed:f68047cb-8eb7-4646-831d-ac7ecea60a98 for instance d2690bd0-5fca-4960-b86c-ca587fd564ec on hv-cinder-83602 Aug 10 13:30:35.746967 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-803c9ad8-e3de-45ca-818a-05f7789c4ed2 req-9a877a38-d0bf-43b0-a989-123981c97b50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035598 Aug 10 13:30:35.747572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 357/708] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:35.872177 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:35.872795 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:35.879254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:35.881184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:35.881184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:35.881184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:35.881811 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:35.882409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:36.056182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:36.065110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d5557f4f-11ea-4882-9335-0caf012e2d66 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.197428 Aug 10 13:30:36.065782 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 352/709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:35 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:37.087857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:37.088580 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:37.094665 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:37.095144 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:37.095575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:37.096257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:37.096709 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:37.097174 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:37.242166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:37.250697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d442e970-bd8e-4acc-b41f-943ef742c7d1 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.167557 Aug 10 13:30:37.251265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 358/710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:37 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:38.271956 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:38.272567 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:38.280065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:38.280555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:38.281017 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:38.281704 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:38.282205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:38.282628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:38.424175 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:38.432062 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5a01d60c-6535-4db7-bd4c-917e15af797e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.164112 Aug 10 13:30:38.433234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 353/711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:38 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:38.694910 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:38.695409 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:38.702499 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:38.702989 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:38.703423 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:38.704121 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:38.704634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:38.705079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:38.723896 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:38.731611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:30:39.021566 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f8da0709-2e1f-4adb-a3ee-3b3322dc7d2d tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "DELETE /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 204 len: 0 microversion: 2.1 time: 0.330123 Aug 10 13:30:39.027074 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 359/712] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:30:38 2022] DELETE /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:30:39.031432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:39.032052 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:39.038685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:39.039168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:39.039611 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:39.040303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:39.040758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:39.041218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:39.184709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:39.192411 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-57ed2816-5ce2-4686-8e16-1e47857d4c5a tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1509 microversion: 2.1 time: 0.165863 Aug 10 13:30:39.192978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 354/713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:39 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:39.455564 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:39.456203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:39.462389 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:39.462879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:39.463317 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:39.464024 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:39.464642 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:39.465200 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:39.621721 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:39.630003 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5562bf76-e322-4cf8-8ea0-bf7b8489e337 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.178657 Aug 10 13:30:39.633034 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 360/714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:39 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:40.215859 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:40.216514 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:40.222708 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.223298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.223798 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.224525 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.224975 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.225441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.365235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:40.373165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ebc79f02-f6e6-43fa-9c0c-85e45d7a19e4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1509 microversion: 2.1 time: 0.163507 Aug 10 13:30:40.373754 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 355/715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:40 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:40.651407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:40.652158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:40.658994 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.659977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.660172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.660875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.661422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.661879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.811911 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:40.820207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-27621fc1-dd5f-4821-8f01-bcba91702f30 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.172663 Aug 10 13:30:40.820790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 361/716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:40 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:41.291639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:41.292693 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:41.294589 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:41.299552 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:41.300050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:41.300492 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:41.301560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:41.301954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:41.302454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:41.319622 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=100 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:41.326423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-550878cc-d594-44dd-9759-6e65e5b7c192 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/ips" status: 200 len: 150 microversion: 2.1 time: 0.171835 Aug 10 13:30:41.327001 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 356/717] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:30:41 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/ips => generated 150 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:41.394449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:41.395061 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:41.401279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:41.401771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:41.402732 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:41.402977 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:41.403444 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:41.403869 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:41.571032 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:41.578919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-90a9a32f-7d51-4482-82cb-d6ac97f1d21f tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1509 microversion: 2.1 time: 0.188286 Aug 10 13:30:41.582302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 362/718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:41 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:41.852070 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:41.853206 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:41.862015 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:41.864572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:41.864572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:41.864572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:41.864572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:41.864868 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:42.040820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:42.052615 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-84fff1fc-88dd-4cad-b9e5-294cbda787c4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.208786 Aug 10 13:30:42.053213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 357/719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:41 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:42.196223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-ab51e28e-f2d7-4584-8ecd-9f0381e73ff3 req-f9125d2a-fcfb-439b-902b-bd69165c0954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654558bd-c765-4b55-96d4-c73b1fda4cb9", "name": "network-vif-deleted", "tag": "66bba97d-ca44-4433-a3e8-773aa5032944"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:42.208359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ab51e28e-f2d7-4584-8ecd-9f0381e73ff3 req-f9125d2a-fcfb-439b-902b-bd69165c0954 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:42.209426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ab51e28e-f2d7-4584-8ecd-9f0381e73ff3 req-f9125d2a-fcfb-439b-902b-bd69165c0954 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:42.209893 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-ab51e28e-f2d7-4584-8ecd-9f0381e73ff3 req-f9125d2a-fcfb-439b-902b-bd69165c0954 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:42.241817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-ab51e28e-f2d7-4584-8ecd-9f0381e73ff3 req-f9125d2a-fcfb-439b-902b-bd69165c0954 service nova] Creating event network-vif-deleted:66bba97d-ca44-4433-a3e8-773aa5032944 for instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 on hv-cinder-83602 Aug 10 13:30:42.257225 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-ab51e28e-f2d7-4584-8ecd-9f0381e73ff3 req-f9125d2a-fcfb-439b-902b-bd69165c0954 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059196 Aug 10 13:30:42.257225 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 363/720] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:42.600472 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:42.601543 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:42.612120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:42.613806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:42.613806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:42.614771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:42.615229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:42.615895 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:42.654924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:42.654924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:42.654924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:42.655289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lazy-loading 'fault' on Instance uuid 654558bd-c765-4b55-96d4-c73b1fda4cb9 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:30:42.702184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:42.715150 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d4b32b04-594d-4328-b585-e1d6bd048b5b tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 200 len: 1312 microversion: 2.1 time: 0.114424 Aug 10 13:30:42.715150 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 358/721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:42 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:43.074485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:43.075175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:43.082177 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.082769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.083346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.084200 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.084747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.085318 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.099534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c7c251b-2557-4c3c-9795-0dc04d68a65e"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:43.102205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:43.116908 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.117549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.118098 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.118861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.119318 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.119732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.254384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:43.266079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-054776df-41f6-4fa1-babb-85f63cf64a86 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.196468 Aug 10 13:30:43.269543 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 364/722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:43 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:43.732922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:43.733715 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: 654558bd-c765-4b55-96d4-c73b1fda4cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:43.739863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.740344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.740786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.741519 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.741982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.742409 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.757292 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] HTTP exception thrown: Instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 could not be found. Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Request method failure captured: Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 HTTP/1.1 Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HI8d6dqhS5K-ZbrX184FWe_fKIHc4FnlHdDzwnLTq8-Y3JD5vSjoVyD0ZRKwi7HBpcs2JMi38-2hM5ZGw9WCKfkOWYwVBtjiwW4NDea0c2b5B7VAoskt-n6HGpwWC7Ob_NVt3sYHk6M9GNnMMsYUc7WWG-Zoyju8lMuZrQ63R0c1s Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:30:43.759006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0c9fae66a6f4ac9a0c1b0629e597906", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 4dfd3ee79da943b189824630b5c393ee Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 could not be found. Aug 10 13:30:43.760569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '654558bd-c765-4b55-96d4-c73b1fda4cb9'} Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 could not be found. Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:43.761620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 could not be found. Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 could not be found. Aug 10 13:30:43.763071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:43.764897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Returning 404 to user: Instance 654558bd-c765-4b55-96d4-c73b1fda4cb9 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:43.764897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ba3c9451-99f1-4363-9991-1d824e38f2d4 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9" status: 404 len: 111 microversion: 2.1 time: 0.032111 Aug 10 13:30:43.765440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 365/723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:43 2022] GET /compute/v2.1/servers/654558bd-c765-4b55-96d4-c73b1fda4cb9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:30:43.770183 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:43.770677 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:43.781670 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.781670 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.781670 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.781670 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.782752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.782752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.814988 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:30:43.928546 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-177a21aa-fad3-40d5-940f-ef92a663b505 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833605 Aug 10 13:30:43.930829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 359/724] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:30:43 2022] POST /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:30:44.136511 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8b47399e-d1f0-4ac4-b473-c15cbb152ee1 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 204 len: 0 microversion: 2.1 time: 0.369089 Aug 10 13:30:44.136948 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 366/725] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:30:43 2022] DELETE /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:30:44.145817 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:44.146524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:44.155898 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.156409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.156850 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.157794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.158264 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.158699 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.290403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:44.291107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:44.301488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:44.301625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.301625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.301625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.301625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.302127 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.302127 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.307771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b2b7b164-1a70-4122-8136-21d4814db296 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.166212 Aug 10 13:30:44.308348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 360/726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:44 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:44.455284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:44.465083 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-029ad1f8-c27a-4bc0-b99d-007f66f75a0d tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.179319 Aug 10 13:30:44.465851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 367/727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:44 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:45.328604 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:45.329952 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:45.336605 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:45.337118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:45.337597 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:45.338288 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:45.338903 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:45.339341 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:45.474035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:45.483479 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4fee38dd-d2fe-4c5e-b2b3-ff7fb286bdd8 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.158710 Aug 10 13:30:45.484066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 361/728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:45 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:45.486838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:45.487448 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:45.493589 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:45.494093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:45.494524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:45.495754 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:45.496262 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:45.496627 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:45.648878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:45.658498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-41fd972c-ea1e-4d58-8a3c-bb8636b7c756 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.175774 Aug 10 13:30:45.659527 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 368/729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:45 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:46.505658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:46.506288 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:46.513601 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:46.514085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:46.514519 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:46.515204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:46.515652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:46.516098 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:46.648681 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:46.656520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-422e8e8f-1afb-4f47-87a3-98720579ba68 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.154703 Aug 10 13:30:46.661024 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 362/730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:46 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:46.679694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:46.680307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:46.683493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:46.688248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:46.703081 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:46.703081 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:46.703081 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:46.703081 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:46.703417 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:46.837309 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:46.846704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f98c3c87-8ae5-4244-a3e7-a917d208c477 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.170784 Aug 10 13:30:46.847301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 369/731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:46 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:47.677854 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:47.678461 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:47.685539 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:47.686063 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:47.686507 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:47.687211 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:47.687664 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:47.688089 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:47.821709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:47.830179 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ea0a4958-2525-49e3-93f4-2b9597a82f83 tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1521 microversion: 2.1 time: 0.156258 Aug 10 13:30:47.830754 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 363/732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:47 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:47.869135 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:47.869741 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:47.876971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:47.877434 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:47.877866 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:47.878548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:47.879002 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:47.879456 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:48.118056 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:48.126549 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b6e6ec1c-ddd3-4697-8e4c-18c8126174b3 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1756 microversion: 2.1 time: 0.261292 Aug 10 13:30:48.127167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 370/733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:47 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:48.464640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-d655d370-17c1-4d19-a928-85b86cca1e98 req-9210e33a-d2f0-48f1-a4fd-726bed225b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f649e3d1-de4b-489a-9cd9-5812f58f3258", "name": "network-vif-deleted", "tag": "eaf4a86a-3558-4360-a95c-6efcd16945c2"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:48.474261 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-d655d370-17c1-4d19-a928-85b86cca1e98 req-9210e33a-d2f0-48f1-a4fd-726bed225b6a service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:48.474761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-d655d370-17c1-4d19-a928-85b86cca1e98 req-9210e33a-d2f0-48f1-a4fd-726bed225b6a service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:48.475187 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-d655d370-17c1-4d19-a928-85b86cca1e98 req-9210e33a-d2f0-48f1-a4fd-726bed225b6a service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:48.486873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-d655d370-17c1-4d19-a928-85b86cca1e98 req-9210e33a-d2f0-48f1-a4fd-726bed225b6a service nova] Creating event network-vif-deleted:eaf4a86a-3558-4360-a95c-6efcd16945c2 for instance f649e3d1-de4b-489a-9cd9-5812f58f3258 on hv-cinder-83602 Aug 10 13:30:48.491783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-d655d370-17c1-4d19-a928-85b86cca1e98 req-9210e33a-d2f0-48f1-a4fd-726bed225b6a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082612 Aug 10 13:30:48.492364 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 364/734] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:48.851105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:48.851802 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:48.859019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:48.859768 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:48.860213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:48.860916 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:48.861579 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:48.862005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:48.927287 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfd3ee79da943b189824630b5c393ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c9fae66a6f4ac9a0c1b0629e597906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:48.937530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7f94cf7b-a970-436c-91e0-12d2437abbbc tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 200 len: 1306 microversion: 2.1 time: 0.090247 Aug 10 13:30:48.938550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 371/735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:48 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:49.148197 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:49.148896 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:49.155108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:49.155616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:49.156053 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:49.156741 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:49.157235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:49.157661 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:49.302179 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:49.311342 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-48d2645d-65ed-452e-bb54-ae6e6e6f6f89 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1759 microversion: 2.1 time: 0.167808 Aug 10 13:30:49.311921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 365/736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:49 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:49.958615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:49.959296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] [instance: f649e3d1-de4b-489a-9cd9-5812f58f3258] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:49.966532 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:49.967008 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:49.967439 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:49.968132 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:49.968567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:49.968982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:49.982838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] HTTP exception thrown: Instance f649e3d1-de4b-489a-9cd9-5812f58f3258 could not be found. Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Request method failure captured: Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 HTTP/1.1 Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HI8d6dqhS5K-ZbrX184FWe_fKIHc4FnlHdDzwnLTq8-Y3JD5vSjoVyD0ZRKwi7HBpcs2JMi38-2hM5ZGw9WCKfkOWYwVBtjiwW4NDea0c2b5B7VAoskt-n6HGpwWC7Ob_NVt3sYHk6M9GNnMMsYUc7WWG-Zoyju8lMuZrQ63R0c1s Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:30:49.984474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0c9fae66a6f4ac9a0c1b0629e597906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0c9fae66a6f4ac9a0c1b0629e597906", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: c0c9fae66a6f4ac9a0c1b0629e597906 Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274838111 Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 4dfd3ee79da943b189824630b5c393ee Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274838111-project Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance f649e3d1-de4b-489a-9cd9-5812f58f3258 could not be found. Aug 10 13:30:49.986028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'f649e3d1-de4b-489a-9cd9-5812f58f3258'} Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f649e3d1-de4b-489a-9cd9-5812f58f3258 could not be found. Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:49.986834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f649e3d1-de4b-489a-9cd9-5812f58f3258 could not be found. Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f649e3d1-de4b-489a-9cd9-5812f58f3258 could not be found. Aug 10 13:30:49.988007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:30:49.989128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] Returning 404 to user: Instance f649e3d1-de4b-489a-9cd9-5812f58f3258 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:49.989128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a4af3439-78fa-4205-9fa1-8c1feeedb0eb tempest-ServerRescueNegativeTestJSON-1274838111 tempest-ServerRescueNegativeTestJSON-1274838111-project] 10.222.0.40 "GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258" status: 404 len: 111 microversion: 2.1 time: 0.031172 Aug 10 13:30:49.989128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 372/737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:49 2022] GET /compute/v2.1/servers/f649e3d1-de4b-489a-9cd9-5812f58f3258 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:30:52.598050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:52.598646 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:52.605252 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:52.606283 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:52.606729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:52.607420 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:52.607868 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:52.608289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:52.643537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-aa88996d-7132-41f9-9259-13d9e72952a8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments/5b32cef7-ac09-4b3b-b5c3-078dc8e79e2a" status: 200 len: 194 microversion: 2.20 time: 0.049483 Aug 10 13:30:52.644398 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 366/738] 10.222.0.40 () {60 vars in 1454 bytes} [Wed Aug 10 13:30:52 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments/5b32cef7-ac09-4b3b-b5c3-078dc8e79e2a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:30:52.727227 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:52.727888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:52.735427 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:52.738671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:52.738671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:52.738671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:52.738671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:52.739060 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:52.830454 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'services' on Instance uuid e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:30:53.067353 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c6bb527a-7b7c-4efe-bb43-f3fa9f1155ac tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments/5b32cef7-ac09-4b3b-b5c3-078dc8e79e2a" status: 202 len: 0 microversion: 2.20 time: 0.343974 Aug 10 13:30:53.070623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 373/739] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Aug 10 13:30:52 2022] DELETE /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments/5b32cef7-ac09-4b3b-b5c3-078dc8e79e2a => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:30:53.077767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:53.080009 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:53.085975 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:53.086450 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:53.086877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:53.087794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:53.088003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:53.088423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:53.120267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ca7b562b-2fc1-46c5-8d62-4cc22d934cfd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047783 Aug 10 13:30:53.120826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 367/740] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 10 13:30:53 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:30:54.135189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:54.138193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:54.144303 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:54.145199 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:54.145320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:54.145927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:54.146368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:54.146795 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:54.150517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:54.178069 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b395e5cb-f654-48b8-a0a6-162b062fd15a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047776 Aug 10 13:30:54.178978 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 374/741] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 10 13:30:54 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:30:54.675020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c7c251b-2557-4c3c-9795-0dc04d68a65e"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:54.677333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:54.684404 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:54.685647 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:54.686085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:54.686774 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:54.687225 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:54.687642 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:54.767144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Invalid volume: volume 3c7c251b-2557-4c3c-9795-0dc04d68a65e is already attached to instances: 5c655ab7-4709-47e3-88ea-1841fa80d3fe Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: POST /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments HTTP/1.1 Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 74 Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:30:54.768828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {"volumeAttachment": {"volumeId": "3c7c251b-2557-4c3c-9795-0dc04d68a65e"}} Aug 10 13:30:54.770439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Invalid volume: volume 3c7c251b-2557-4c3c-9795-0dc04d68a65e is already attached to instances: 5c655ab7-4709-47e3-88ea-1841fa80d3fe Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'server_id': '5c655ab7-4709-47e3-88ea-1841fa80d3fe', 'body': {'volumeAttachment': {'volumeId': '3c7c251b-2557-4c3c-9795-0dc04d68a65e'}}} Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3c7c251b-2557-4c3c-9795-0dc04d68a65e is already attached to instances: 5c655ab7-4709-47e3-88ea-1841fa80d3fe Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:30:54.771346 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3c7c251b-2557-4c3c-9795-0dc04d68a65e is already attached to instances: 5c655ab7-4709-47e3-88ea-1841fa80d3fe Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:54.772530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:54.778343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:54.778343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:54.778343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:54.778343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3c7c251b-2557-4c3c-9795-0dc04d68a65e is already attached to instances: 5c655ab7-4709-47e3-88ea-1841fa80d3fe Aug 10 13:30:54.778343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:30:54.778343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 400 to user: Invalid volume: volume 3c7c251b-2557-4c3c-9795-0dc04d68a65e is already attached to instances: 5c655ab7-4709-47e3-88ea-1841fa80d3fe {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:54.778343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ac5fba15-354b-418c-a48f-5b48efa58162 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099990 Aug 10 13:30:54.778343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 368/742] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:30:54 2022] POST /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:30:54.837004 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:54.837501 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:54.844185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:54.844762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:54.845220 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:54.845904 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:54.846358 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:54.846778 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:54.929031 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lazy-loading 'services' on Instance uuid 5c655ab7-4709-47e3-88ea-1841fa80d3fe {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:30:55.169241 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-709d3f7c-c3e8-4d00-8ecd-01c33db9efe2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments/3c7c251b-2557-4c3c-9795-0dc04d68a65e" status: 202 len: 0 microversion: 2.1 time: 0.335339 Aug 10 13:30:55.169952 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 375/743] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:30:54 2022] DELETE /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments/3c7c251b-2557-4c3c-9795-0dc04d68a65e => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:30:55.179391 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:55.181603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:55.189961 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:55.193365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:55.193365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:55.193365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:55.193365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:55.194055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:55.194306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:55.194510 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:55.200833 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:55.201607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:55.202197 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:55.202894 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:55.203347 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:55.203971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:55.225530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b52a1ecf-5948-4158-8dba-2cb7dddaf470 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050273 Aug 10 13:30:55.226106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 369/744] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:30:55 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:55.236864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-39bbb686-eaae-4a21-9b20-d89d812ddb17 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049659 Aug 10 13:30:55.237467 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 376/745] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 10 13:30:55 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:55.305120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:55.305616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:55.312323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:55.312805 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:55.313429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:55.314309 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:55.314756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:55.315342 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:55.340232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:30:55.477653 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:55.685382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9ba6e705-018d-4c82-822a-3dcc3e34d458 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 204 len: 0 microversion: 2.20 time: 0.383691 Aug 10 13:30:55.689035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 370/746] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Aug 10 13:30:55 2022] DELETE /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:30:55.694650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:55.695258 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:55.702355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:55.702841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:55.703271 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:55.703963 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:55.704413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:55.704844 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:55.844021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:55.852177 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:55.853867 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:55.855015 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-65503ce2-92c0-4d84-a183-96da6db1c690 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.164861 Aug 10 13:30:55.856128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 377/747] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:55 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:30:56.238590 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:56.240764 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:56.246761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:56.247238 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:56.247705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:56.248397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:56.248850 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:56.249298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:56.280135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e8476748-7ee3-45e8-bdbc-1225cbc61a8d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045771 Aug 10 13:30:56.280829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 371/748] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:30:56 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:56.881515 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:56.882122 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:56.888421 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:56.888891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:56.889352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:56.890031 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:56.890479 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:56.890895 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:57.024076 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:57.030594 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:57.032101 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:57.033282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-46da32dc-2fae-4086-adff-a204a1a98ffc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1724 microversion: 2.20 time: 0.155613 Aug 10 13:30:57.033839 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 378/749] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:56 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:57.292969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:57.295086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:57.301435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:57.301914 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:57.302353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:57.303037 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:57.303492 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:57.303915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:57.334754 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-19f9895f-7722-4f76-a583-331fcc6bef29 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Aug 10 13:30:57.335323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 372/750] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:30:57 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:58.057993 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:58.058780 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:58.065844 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.066467 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.066899 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:58.067597 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.068047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.068464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:58.164055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:58.172943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:58.174475 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:58.175619 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8d5ada0e-ad8b-4a17-b699-cc5c83f1316e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1656 microversion: 2.20 time: 0.122538 Aug 10 13:30:58.176175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 379/751] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:58 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1656 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:30:58.349878 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:58.352165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:58.360559 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.361152 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.361687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:58.362634 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.363328 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.363961 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:58.399384 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b915c626-69c6-4391-8b0d-7798da4ba7ab tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053791 Aug 10 13:30:58.407320 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 373/752] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:30:58 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:30:58.417484 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-1dd1a635-329e-4129-80c1-1cd371fa19ba req-104c7d7e-802f-4b4a-b0de-32f842070985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88fd6a8-9262-4f5c-9b91-ed4e70704cb9", "name": "network-vif-deleted", "tag": "ea8828a3-61d3-4d2e-9d76-db0b898a6fd4"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:58.431216 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1dd1a635-329e-4129-80c1-1cd371fa19ba req-104c7d7e-802f-4b4a-b0de-32f842070985 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.432453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1dd1a635-329e-4129-80c1-1cd371fa19ba req-104c7d7e-802f-4b4a-b0de-32f842070985 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.433134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1dd1a635-329e-4129-80c1-1cd371fa19ba req-104c7d7e-802f-4b4a-b0de-32f842070985 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:58.445860 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-1dd1a635-329e-4129-80c1-1cd371fa19ba req-104c7d7e-802f-4b4a-b0de-32f842070985 service nova] Creating event network-vif-deleted:ea8828a3-61d3-4d2e-9d76-db0b898a6fd4 for instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 on hv-cinder-83602 Aug 10 13:30:58.454562 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-1dd1a635-329e-4129-80c1-1cd371fa19ba req-104c7d7e-802f-4b4a-b0de-32f842070985 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040991 Aug 10 13:30:58.464910 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 380/753] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:58.483841 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:58.484691 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:58.491746 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.492327 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.494897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:58.494897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.494897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.494897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:58.530126 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:30:58.910977 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-79076dc9-6941-49aa-8812-c27284badf1d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 204 len: 0 microversion: 2.1 time: 0.433560 Aug 10 13:30:58.912140 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 374/754] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:30:58 2022] DELETE /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:30:58.921328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:58.922112 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:58.928503 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.929014 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.929451 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:58.930142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:58.930594 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:58.931011 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:59.090875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:59.100324 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c9e54811-fccc-4611-bef8-f06bff384828 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1681 microversion: 2.1 time: 0.183736 Aug 10 13:30:59.100896 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 381/755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:58 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:59.199141 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:59.199840 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:59.206008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:59.206490 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:59.206928 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:59.207647 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:59.208145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:59.208511 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:59.242044 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:59.242523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:59.242962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:59.243428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'fault' on Instance uuid e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:30:59.289430 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:59.298756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:59.300265 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:59.301504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d5c98e21-4bfb-4a62-a1d6-ca519f8d7c77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1370 microversion: 2.20 time: 0.106674 Aug 10 13:30:59.302062 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 375/756] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:30:59 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:00.123212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:00.123877 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:00.130033 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:00.130511 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:00.130943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:00.131623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:00.132077 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:00.132493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:00.265221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:00.272805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1a510b9c-c5bf-4277-948c-d04486ac4aad tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1681 microversion: 2.1 time: 0.153453 Aug 10 13:31:00.273508 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 382/757] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:00 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:00.325127 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:00.325797 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:00.332586 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:00.333089 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:00.333526 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:00.334223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:00.334676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:00.335102 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:00.367135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:00.367619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:00.368054 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:00.368504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'fault' on Instance uuid e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:00.409395 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:00.417518 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:00.419031 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:00.420269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4e8db710-c0f8-4614-acfd-adacc0f829b3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1370 microversion: 2.20 time: 0.099184 Aug 10 13:31:00.424357 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 376/758] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:00 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:00.914940 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-80b40c4a-0bb0-4bc9-93c1-b23c2717b34c req-9ae7ac8d-8e09-4edd-8ea5-2f3a20983616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c655ab7-4709-47e3-88ea-1841fa80d3fe", "name": "network-vif-unplugged", "status": "completed", "tag": "4811b202-c18c-4dab-82bd-c56b9dcb0764"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:00.925894 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-80b40c4a-0bb0-4bc9-93c1-b23c2717b34c req-9ae7ac8d-8e09-4edd-8ea5-2f3a20983616 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:00.926499 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-80b40c4a-0bb0-4bc9-93c1-b23c2717b34c req-9ae7ac8d-8e09-4edd-8ea5-2f3a20983616 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:00.927178 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-80b40c4a-0bb0-4bc9-93c1-b23c2717b34c req-9ae7ac8d-8e09-4edd-8ea5-2f3a20983616 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:00.939291 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-80b40c4a-0bb0-4bc9-93c1-b23c2717b34c req-9ae7ac8d-8e09-4edd-8ea5-2f3a20983616 service nova] Creating event network-vif-unplugged:4811b202-c18c-4dab-82bd-c56b9dcb0764 for instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe on hv-cinder-83602 Aug 10 13:31:00.944185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-80b40c4a-0bb0-4bc9-93c1-b23c2717b34c req-9ae7ac8d-8e09-4edd-8ea5-2f3a20983616 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033497 Aug 10 13:31:00.944881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 383/759] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:01.296114 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:01.296725 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:01.302577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:01.304488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:01.304488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:01.304488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:01.304768 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:01.305094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:01.440538 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:01.444245 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:01.444940 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:01.448244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d777c32e-893d-4d23-a219-6ea14c6c98be tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1681 microversion: 2.1 time: 0.156503 Aug 10 13:31:01.448910 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 377/760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:01 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:01.458408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:01.458408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:01.458408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:01.458408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:01.458879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:01.458879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:01.489235 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:01.489430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:01.489875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:01.490325 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'fault' on Instance uuid e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:01.536941 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:01.545470 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:01.547006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:01.548156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b783f706-e7d0-4302-9080-7922c42d8315 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1370 microversion: 2.20 time: 0.108550 Aug 10 13:31:01.548716 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 384/761] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:01 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:01.971463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-33403b42-0297-4f4b-941d-a57205035fe7 req-3e1a754a-26c5-4aff-a69a-372be6468e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c655ab7-4709-47e3-88ea-1841fa80d3fe", "name": "network-vif-deleted", "tag": "4811b202-c18c-4dab-82bd-c56b9dcb0764"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:01.980703 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-33403b42-0297-4f4b-941d-a57205035fe7 req-3e1a754a-26c5-4aff-a69a-372be6468e2c service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:01.981222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-33403b42-0297-4f4b-941d-a57205035fe7 req-3e1a754a-26c5-4aff-a69a-372be6468e2c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:01.982715 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-33403b42-0297-4f4b-941d-a57205035fe7 req-3e1a754a-26c5-4aff-a69a-372be6468e2c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:01.993317 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-33403b42-0297-4f4b-941d-a57205035fe7 req-3e1a754a-26c5-4aff-a69a-372be6468e2c service nova] Creating event network-vif-deleted:4811b202-c18c-4dab-82bd-c56b9dcb0764 for instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe on hv-cinder-83602 Aug 10 13:31:01.998814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-33403b42-0297-4f4b-941d-a57205035fe7 req-3e1a754a-26c5-4aff-a69a-372be6468e2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030988 Aug 10 13:31:01.999614 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 378/762] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:02.470240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:02.470845 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:02.477622 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:02.478112 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:02.478548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:02.479247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:02.479700 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:02.480123 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:02.572515 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:02.573859 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:02.581170 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:02.581966 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:02.582402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:02.583114 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:02.583565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:02.583988 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:02.619550 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:02.620036 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:02.620455 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:02.621116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'fault' on Instance uuid e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:02.665444 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:02.674168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:02.675825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:02.677016 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2a395bbd-1dfc-4045-adbc-dcdce3451684 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1370 microversion: 2.20 time: 0.108823 Aug 10 13:31:02.677593 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 379/763] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:02 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:02.702491 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:02.709985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7cafa431-b196-4e09-ad9a-a656a52f0329 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1613 microversion: 2.1 time: 0.244193 Aug 10 13:31:02.710607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 385/764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:02 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1613 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:03.699831 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:03.700960 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:03.707398 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:03.716945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:03.716945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:03.716945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:03.716945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:03.717632 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:03.735059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:03.736576 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:03.746608 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:03.748074 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:03.748662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:03.749368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:03.750099 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:03.750365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'fault' on Instance uuid e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:03.750720 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:03.751944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:03.752646 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:03.753288 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:03.800710 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:03.808148 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:03.809690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:03.811732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-98784675-d0c4-44af-a484-df03fc6b0f4a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 200 len: 1370 microversion: 2.20 time: 0.115916 Aug 10 13:31:03.813939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 380/765] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:03 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 1370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:03.824324 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:03.832198 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-bfba49d5-7716-41d9-9ed6-8ff5f644f142 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 200 len: 1325 microversion: 2.1 time: 0.103936 Aug 10 13:31:03.832750 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 386/766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:03 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:04.833945 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:04.834573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:04.840829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:04.841364 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:04.841796 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:04.842488 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:04.842935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:04.843356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:04.852236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:04.852970 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:04.856624 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] HTTP exception thrown: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Request method failure captured: Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 HTTP/1.1 Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87Iawk_SGRtFXxAR4dnF9oFgvNnvMCL53p0i0nAIlPLXMVHfcGCRo03F_hZczfUkL5A8Mvam6_bwTRjaQmRPqLccgyyoqsMJrCmSdBx8G4OgyWWVV1JbzR8sbz_jRrT1z-XLedOAnXUeYzVS5vPbQ3D5dPVKEAcHpBvE4KB2iLmPgYg Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:31:04.858289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a60a5752fcba46359ef5275f506c933a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 1945fed03f73472db818c4e5ca015eb7 Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:31:04.860069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'e88fd6a8-9262-4f5c-9b91-ed4e70704cb9'} Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:04.860935 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:31:04.862243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.865298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Returning 404 to user: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:04.865467 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:04.865467 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:04.865642 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cc82b347-9059-4f2a-ac2b-6d8ae3ceca77 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 404 len: 111 microversion: 2.20 time: 0.031687 Aug 10 13:31:04.865727 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:04.865803 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 381/767] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:04 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:31:04.865876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:04.865876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:04.865876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:04.870970 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2e131168-ef6f-4b50-9ade-4a707a1936bd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '.version_select at 0x7ff6a375a160>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:04.878983 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe HTTP/1.1 Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:31:04.880590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:31:04.881919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '5c655ab7-4709-47e3-88ea-1841fa80d3fe'} Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:04.882818 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:31:04.885296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:04.888814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:04.888814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7f5a0c42-cff4-4544-9357-c19292c8da71 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 404 len: 111 microversion: 2.1 time: 0.033854 Aug 10 13:31:04.888814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 387/768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:04 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:31:04.892275 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-914b44ae-9288-4f40-ac43-cca299550ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '.version_select at 0x7ff6a3638f70>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:04.982301 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2e131168-ef6f-4b50-9ade-4a707a1936bd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-221126440" status: 204 len: 0 microversion: 2.20 time: 0.115037 Aug 10 13:31:04.983395 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 382/769] 10.222.0.40 () {60 vars in 1259 bytes} [Wed Aug 10 13:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-221126440 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:31:05.002188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-914b44ae-9288-4f40-ac43-cca299550ec8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179747253" status: 202 len: 0 microversion: 2.1 time: 0.114757 Aug 10 13:31:05.003415 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 388/770] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 10 13:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179747253 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:31:05.837386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-08673b11-e362-493f-9548-42a03f2098c8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: .version_select at 0x7ff6a3779940>, body: {"keypair": {"name": "tempest-keypair-577956715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIftDFXVQ4cifYL2Zm5w6/2I8t47KKUawAMnHu7hgXOR749O/lOzcNsvhZOOdTHsFX6/1Y8gAm3cDKML3Zbhy/8fxvHsORafkiVbQFhfIv/OvoWr5YgvqH+Y/WoDiExSlw=="}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:05.855709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-08673b11-e362-493f-9548-42a03f2098c8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for project 26a97b47cc804e598c5e8680d279de19. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:31:05.860210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-08673b11-e362-493f-9548-42a03f2098c8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for user c9577bc4c4c546ca9fc220ebd3a16346 and project 26a97b47cc804e598c5e8680d279de19. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:31:05.988326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-08673b11-e362-493f-9548-42a03f2098c8 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154907 Aug 10 13:31:05.988980 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 383/771] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:31:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:06.047764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d8246742-43ac-4569-8c29-67898aba4a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'create', calling method: .version_select at 0x7ff6a3717280>, body: {"keypair": {"name": "tempest-keypair-1734203409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWHj1HW+PrnI1fEJAqaajbcUO+6CaTkywheSxUaEJC2S8qU5hTTIqFxExLAzN97SlSu1npEpl9aiFvFOTm2QeJNYq2NfZpP6jC92X4zfdJBaydTohbDbTiuQMjEdo1DCQ=="}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:06.063889 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-d8246742-43ac-4569-8c29-67898aba4a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Getting quotas for project a60a5752fcba46359ef5275f506c933a. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:31:06.068464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-d8246742-43ac-4569-8c29-67898aba4a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Getting quotas for user 1945fed03f73472db818c4e5ca015eb7 and project a60a5752fcba46359ef5275f506c933a. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:31:06.164353 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d8246742-43ac-4569-8c29-67898aba4a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.121241 Aug 10 13:31:06.164987 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 389/772] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Aug 10 13:31:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 13:31:08.397050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-47198395", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0166bef-5b21-4630-8f39-894ba8f20530"}], "security_groups": [{"name": "tempest-securitygroup--1932560623"}], "key_name": "tempest-keypair-577956715", "user_data": "}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:08.513235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] validate_networks() for [('e0166bef-5b21-4630-8f39-894ba8f20530', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:31:08.726666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-49455877", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7c1ce82-d1fa-4708-a8c1-8d792d57f953"}], "security_groups": [{"name": "tempest-securitygroup--198812649"}], "key_name": "tempest-keypair-1734203409", "user_data": "}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:08.844710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.network.neutron [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] validate_networks() for [('c7c1ce82-d1fa-4708-a8c1-8d792d57f953', None, None, None, None, None)] {{(pid=118003) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:31:09.021958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:31:09.022376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:31:09.022844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:31:09.023245 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:31:09.023653 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:31:09.033681 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:09.034421 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:09.034851 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:09.035567 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:09.036065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:09.036483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:09.055549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for project 26a97b47cc804e598c5e8680d279de19. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:31:09.068378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Getting quotas for user c9577bc4c4c546ca9fc220ebd3a16346 and project 26a97b47cc804e598c5e8680d279de19. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:31:09.070929 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:09.081536 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:31:09.083812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:31:09.218206 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-50f20b57-a13c-44e5-8a63-1ab0009d9283 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.825794 Aug 10 13:31:09.219293 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 384/773] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:31:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:31:09.230004 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c5bd98df-5e36-477f-b4fb-0b1dab7aa582 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:09.230871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c5bd98df-5e36-477f-b4fb-0b1dab7aa582 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:09.303551 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c5bd98df-5e36-477f-b4fb-0b1dab7aa582 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:09.311696 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c5bd98df-5e36-477f-b4fb-0b1dab7aa582 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1239 microversion: 2.1 time: 0.084765 Aug 10 13:31:09.312640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 385/774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:09 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:31:09.360238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Flavor limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:31:09.360944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Image limits 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:31:09.361762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Flavor pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:31:09.362375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Image pref 0:0:0 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:31:09.362985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.virt.hardware [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:31:09.372167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:09.372672 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:09.373744 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:09.374498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:09.375000 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:09.375430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:09.393045 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Getting quotas for project a60a5752fcba46359ef5275f506c933a. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:31:09.397143 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Getting quotas for user 1945fed03f73472db818c4e5ca015eb7 and project a60a5752fcba46359ef5275f506c933a. Resources: {'instances', 'ram', 'cores'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:31:09.408969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Going to run 1 instances... {{(pid=118003) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:31:09.411513 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:31:09.525862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b4eff585-90a1-4a33-a2f2-b39337824b3e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.804322 Aug 10 13:31:09.533157 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 390/775] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Aug 10 13:31:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 13:31:09.539753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3ef36adb-857e-4a42-8419-23d6b21ce8e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:09.540408 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3ef36adb-857e-4a42-8419-23d6b21ce8e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:09.601922 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3ef36adb-857e-4a42-8419-23d6b21ce8e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:09.610550 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3ef36adb-857e-4a42-8419-23d6b21ce8e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:09.612082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3ef36adb-857e-4a42-8419-23d6b21ce8e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:09.613233 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3ef36adb-857e-4a42-8419-23d6b21ce8e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1280 microversion: 2.20 time: 0.077946 Aug 10 13:31:09.613994 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 386/776] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:09 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:10.334981 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:10.335594 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:10.343484 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:10.344039 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:10.344477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:10.345308 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:10.345764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:10.346201 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:10.419644 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:10.427650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-be50cb3f-2932-40ee-a9e7-5fc7edf262c9 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1243 microversion: 2.1 time: 0.097570 Aug 10 13:31:10.428207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 391/777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:10 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1243 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:10.637250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:10.637896 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:10.644246 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:10.644725 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:10.645204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:10.645880 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:10.646325 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:10.646744 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:10.743698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:10.760132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:10.761678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:10.762833 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a47832a8-2997-42f1-ae12-d37f6b9f8a7f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1284 microversion: 2.20 time: 0.129882 Aug 10 13:31:10.763389 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 387/778] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:10 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:11.449263 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:11.449800 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:11.457847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:11.458352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:11.458792 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:11.459496 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:11.459957 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:11.460379 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:11.527212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:11.535942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-77fc38ac-b6be-4a35-9880-79cc9f108656 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1299 microversion: 2.1 time: 0.090882 Aug 10 13:31:11.536497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 392/779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:11 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:11.787162 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:11.788459 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:11.800661 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:11.801210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:11.801919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:11.802849 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:11.803177 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:11.803610 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:11.873009 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:11.882081 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:11.883634 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:11.896658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-31d02fde-aef4-4cca-8341-50b715872517 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1332 microversion: 2.20 time: 0.101844 Aug 10 13:31:11.896658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 388/780] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:11 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:12.559474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:12.560662 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:12.568811 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:12.569561 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:12.570358 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:12.571231 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:12.571867 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:12.572526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:12.694864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:12.702924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-229c09a5-b326-471a-b04b-e4fa5d29403b tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1297 microversion: 2.1 time: 0.148833 Aug 10 13:31:12.710546 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 393/781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:12 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1297 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:12.911129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:12.911745 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:12.920311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:12.920803 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:12.921894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:12.922598 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:12.923164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:12.923780 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:12.993378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:13.008809 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:13.008809 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:13.008809 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b627375c-ce63-4f10-895e-97c4d417898e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1338 microversion: 2.20 time: 0.102061 Aug 10 13:31:13.009941 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 389/782] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:12 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:13.725771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:13.727364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:13.734270 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:13.734858 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:13.735550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:13.736501 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:13.737276 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:13.737478 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:13.758252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:14.039961 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:14.042297 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:14.049345 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:14.050087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:14.050548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:14.051443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:14.051893 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:14.052478 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:14.074721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:14.204761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:14.212914 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:14.214440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:14.215651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6f3d36ab-303f-4dcc-9156-84be98946713 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1405 microversion: 2.20 time: 0.179800 Aug 10 13:31:14.216207 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 390/783] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:14 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:31:14.252878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:14.260283 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6218c4c7-acf1-439e-b832-cfc5bcae1bfa tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.538407 Aug 10 13:31:14.260933 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 394/784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:13 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:14.712637 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-aa022ae6-1212-4a9f-8604-f82c34b2d659 req-b6354f9d-5ab3-4035-bad6-3dda0c0f7c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99c255d-d210-4be5-9251-441c5103a1ac", "tag": "39c4c2d7-4497-410a-8487-c926c213dd87"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:14.722697 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-aa022ae6-1212-4a9f-8604-f82c34b2d659 req-b6354f9d-5ab3-4035-bad6-3dda0c0f7c6f service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:14.723174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-aa022ae6-1212-4a9f-8604-f82c34b2d659 req-b6354f9d-5ab3-4035-bad6-3dda0c0f7c6f service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:14.723595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-aa022ae6-1212-4a9f-8604-f82c34b2d659 req-b6354f9d-5ab3-4035-bad6-3dda0c0f7c6f service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:14.734899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-aa022ae6-1212-4a9f-8604-f82c34b2d659 req-b6354f9d-5ab3-4035-bad6-3dda0c0f7c6f service nova] Creating event network-changed:39c4c2d7-4497-410a-8487-c926c213dd87 for instance a99c255d-d210-4be5-9251-441c5103a1ac on hv-cinder-83602 Aug 10 13:31:14.739897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-aa022ae6-1212-4a9f-8604-f82c34b2d659 req-b6354f9d-5ab3-4035-bad6-3dda0c0f7c6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031368 Aug 10 13:31:14.740958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 391/785] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:15.238652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:15.239257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:15.245504 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:15.245984 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:15.246420 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:15.247166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:15.247624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:15.248044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:15.282609 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:15.283300 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:15.290728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:15.291212 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:15.291649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:15.292350 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:15.292798 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:15.293251 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:15.444109 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:15.454651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-23257f3c-a45f-4a6b-acfa-63cfbdfe5616 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.176378 Aug 10 13:31:15.455242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 392/786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:15 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:31:15.573181 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:15.582051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:15.584009 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:15.585191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7e95a0b0-3889-4968-b773-53eb5825a7ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1405 microversion: 2.20 time: 0.350540 Aug 10 13:31:15.586515 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 395/787] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:15 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1405 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:16.478112 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:16.478812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:16.485793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:16.486454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:16.486890 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:16.487577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:16.488029 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:16.488447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:16.607767 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:16.608588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:16.615537 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:16.616156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:16.616709 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:16.617532 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:16.618166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:16.618592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:16.624066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:16.631592 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a5fef016-f6a4-4661-90be-544d0e243abd tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.157263 Aug 10 13:31:16.632165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 393/788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:16 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:16.759522 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-5868388e-2eda-4627-ae38-95127d3c7165 req-08284a2c-23a2-4990-b981-c21cca97189b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb", "tag": "fb29def7-e001-4e1b-a67d-f091c1548451"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:16.761053 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:16.769077 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-5868388e-2eda-4627-ae38-95127d3c7165 req-08284a2c-23a2-4990-b981-c21cca97189b service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:16.769558 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-5868388e-2eda-4627-ae38-95127d3c7165 req-08284a2c-23a2-4990-b981-c21cca97189b service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:16.769989 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-5868388e-2eda-4627-ae38-95127d3c7165 req-08284a2c-23a2-4990-b981-c21cca97189b service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:16.770343 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:16.771938 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:16.773278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-cc7cc2d0-a421-4ccc-bc80-9060885cce43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1405 microversion: 2.20 time: 0.169295 Aug 10 13:31:16.774162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 396/789] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:16 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:16.781600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-5868388e-2eda-4627-ae38-95127d3c7165 req-08284a2c-23a2-4990-b981-c21cca97189b service nova] Creating event network-changed:fb29def7-e001-4e1b-a67d-f091c1548451 for instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb on hv-cinder-83602 Aug 10 13:31:16.790533 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-5868388e-2eda-4627-ae38-95127d3c7165 req-08284a2c-23a2-4990-b981-c21cca97189b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034797 Aug 10 13:31:16.791329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 394/790] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:31:17.652867 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:17.653533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:17.656136 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:17.675006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:17.675503 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:17.680634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:17.680634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:17.680634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:17.680634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:17.798191 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:17.800790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:17.811437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:17.812984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:17.818270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:17.818270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:17.818270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:17.818270 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:17.879867 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:17.887972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a2533c3c-c7ee-465d-98ca-d63dc5fa1ef2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.238929 Aug 10 13:31:17.888557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 397/791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:17 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:17.988138 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:18.000500 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:18.003508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:18.005340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1d7e5fbf-360b-4178-9919-9f72278883ff tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1405 microversion: 2.20 time: 0.213243 Aug 10 13:31:18.007888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 395/792] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:17 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:18.910027 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:18.910564 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:18.916931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:18.917443 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:18.917871 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:18.918559 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:18.919007 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:18.919428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:19.036439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:19.037158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:19.043382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:19.043860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:19.044291 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:19.044980 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:19.045453 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:19.046215 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:19.047187 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:19.063221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:19.070804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e6839f5a-960c-4676-9d8e-61d21c0e9690 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.165802 Aug 10 13:31:19.071399 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 398/793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:18 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:19.183829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:19.192106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:19.193690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:19.194884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6ffd7d8c-f54f-48e0-83d9-54a082c2645f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1405 microversion: 2.20 time: 0.162766 Aug 10 13:31:19.199822 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 396/794] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:19 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:31:19.972348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:19.973201 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=10 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:20.095623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:20.096254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:20.098141 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=14 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:20.103347 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:20.103966 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:20.107580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:20.107580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:20.107580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:20.107580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:20.117544 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-81edd68b-832c-44e1-84f4-6607b002e718 req-0d07826b-7550-4ead-841d-bacf0fff49b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb", "name": "network-vif-plugged", "status": "completed", "tag": "fb29def7-e001-4e1b-a67d-f091c1548451"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:20.128545 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-81edd68b-832c-44e1-84f4-6607b002e718 req-0d07826b-7550-4ead-841d-bacf0fff49b6 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:20.132964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-81edd68b-832c-44e1-84f4-6607b002e718 req-0d07826b-7550-4ead-841d-bacf0fff49b6 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:20.132964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-81edd68b-832c-44e1-84f4-6607b002e718 req-0d07826b-7550-4ead-841d-bacf0fff49b6 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:20.141096 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-81edd68b-832c-44e1-84f4-6607b002e718 req-0d07826b-7550-4ead-841d-bacf0fff49b6 service nova] Creating event network-vif-plugged:fb29def7-e001-4e1b-a67d-f091c1548451 for instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb on hv-cinder-83602 Aug 10 13:31:20.146227 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-81edd68b-832c-44e1-84f4-6607b002e718 req-0d07826b-7550-4ead-841d-bacf0fff49b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178927 Aug 10 13:31:20.147082 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 399/795] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:20.219011 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:20.219715 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:20.226009 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:20.226578 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:20.227123 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:20.227833 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:20.228292 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:20.228723 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:20.253499 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:20.260876 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cbeb6a26-2cd8-4531-84ef-280b46470afe tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.170803 Aug 10 13:31:20.261498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 397/796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:20 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:31:20.266671 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:20.267365 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:20.273885 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:20.274594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:20.275254 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:20.276176 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:20.276826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:20.277748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:20.305253 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c30c5d0a-6246-4718-926d-c725e26b7113 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/ips" status: 200 len: 146 microversion: 2.1 time: 0.042673 Aug 10 13:31:20.305842 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 398/797] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:31:20 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:20.413789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:20.423260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:20.428522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:20.428522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-59a8c6a9-633a-4c16-97a2-d4c574d7f9db tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1405 microversion: 2.20 time: 0.211968 Aug 10 13:31:20.428522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 400/798] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:20 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:21.288560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:21.289739 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:21.295919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:21.296573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:21.297037 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:21.297730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:21.298180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:21.298605 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:21.433266 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:21.440647 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-bf99adee-aec8-4ede-a45d-e81e6bd4f4af tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.156708 Aug 10 13:31:21.441259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 399/799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:21 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:31:21.447915 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:21.448512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:21.455713 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:21.456187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:21.456614 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:21.457326 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:21.457775 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:21.458199 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:21.596493 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:21.604854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:21.607255 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:21.608978 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1768b0e7-321e-42c3-b7d7-ac66cabf13f1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1405 microversion: 2.20 time: 0.164339 Aug 10 13:31:21.609629 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 401/800] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:21 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:22.038937 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4374824-5157-4288-a1c6-eb74b167da22"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:22.041397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:22.048166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.048655 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.049115 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.049883 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.050342 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.050769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.161555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-319d3ba2-fc6e-4b05-b512-09793a8f6f76 req-e9bec73c-5a33-4507-b723-ad4b7e28dd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99c255d-d210-4be5-9251-441c5103a1ac", "name": "network-vif-plugged", "status": "completed", "tag": "39c4c2d7-4497-410a-8487-c926c213dd87"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:22.176588 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-319d3ba2-fc6e-4b05-b512-09793a8f6f76 req-e9bec73c-5a33-4507-b723-ad4b7e28dd8f service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.177428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-319d3ba2-fc6e-4b05-b512-09793a8f6f76 req-e9bec73c-5a33-4507-b723-ad4b7e28dd8f service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.178112 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-319d3ba2-fc6e-4b05-b512-09793a8f6f76 req-e9bec73c-5a33-4507-b723-ad4b7e28dd8f service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.191857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-319d3ba2-fc6e-4b05-b512-09793a8f6f76 req-e9bec73c-5a33-4507-b723-ad4b7e28dd8f service nova] Creating event network-vif-plugged:39c4c2d7-4497-410a-8487-c926c213dd87 for instance a99c255d-d210-4be5-9251-441c5103a1ac on hv-cinder-83602 Aug 10 13:31:22.196872 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-319d3ba2-fc6e-4b05-b512-09793a8f6f76 req-e9bec73c-5a33-4507-b723-ad4b7e28dd8f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039530 Aug 10 13:31:22.198348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 402/801] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:22.461869 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:22.462567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:22.469964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.470350 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.470902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.471606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.472064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.472490 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.679779 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:22.687408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fc34e6e1-251b-40b4-8796-8276924cd74e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.229599 Aug 10 13:31:22.687994 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 403/802] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:22 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:31:22.692691 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:22.693315 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:22.699499 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.700243 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.700875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.701772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.702935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.707522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.839344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:22.847843 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:22.849468 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:22.850709 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-862aeb53-5097-43f7-aa35-e0ead742a277 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1598 microversion: 2.20 time: 0.161594 Aug 10 13:31:22.851282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 404/803] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:31:22 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:22.873638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:22.874978 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:22.880896 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.881428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.881849 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.882547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:22.883374 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:22.883374 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:22.887464 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ec526ae7-8007-4396-999a-55b53ec83219 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852402 Aug 10 13:31:22.893131 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 400/804] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:31:22 2022] POST /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:22.968645 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3c419c5e-ebfe-44da-b647-e897add813f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098973 Aug 10 13:31:22.969300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 405/805] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Aug 10 13:31:22 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:31:23.709400 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:23.710135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:23.716604 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:23.717112 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:23.718356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:23.719231 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:23.719706 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:23.720168 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:23.944169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:23.954333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-eb104fdd-7cfe-43d0-bd19-d6f32a9813f7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1365 microversion: 2.1 time: 0.249505 Aug 10 13:31:23.955059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 401/806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:23 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:24.412531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-56728306-13ef-455d-afeb-e9361f854ce6 req-3c14f7e8-7c2f-44d2-b3c3-38198336cc13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb", "tag": "fb29def7-e001-4e1b-a67d-f091c1548451"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:24.423055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-56728306-13ef-455d-afeb-e9361f854ce6 req-3c14f7e8-7c2f-44d2-b3c3-38198336cc13 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:24.423632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-56728306-13ef-455d-afeb-e9361f854ce6 req-3c14f7e8-7c2f-44d2-b3c3-38198336cc13 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:24.424142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-56728306-13ef-455d-afeb-e9361f854ce6 req-3c14f7e8-7c2f-44d2-b3c3-38198336cc13 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:24.437621 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-56728306-13ef-455d-afeb-e9361f854ce6 req-3c14f7e8-7c2f-44d2-b3c3-38198336cc13 service nova] Creating event network-changed:fb29def7-e001-4e1b-a67d-f091c1548451 for instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb on hv-cinder-83602 Aug 10 13:31:24.442704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-56728306-13ef-455d-afeb-e9361f854ce6 req-3c14f7e8-7c2f-44d2-b3c3-38198336cc13 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300385 Aug 10 13:31:24.443311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 406/807] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:24.975836 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:24.981071 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:24.983748 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:24.984250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:24.984693 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:24.985640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:24.986255 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:24.986842 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:25.201407 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:25.210050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-57e0da79-6402-47db-99e0-ca0f46a0f3b4 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1555 microversion: 2.1 time: 0.237969 Aug 10 13:31:25.211261 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 402/808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:24 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:25.234550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:25.235234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:25.241648 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:25.242759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:25.243206 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:25.243913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:25.244553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:25.244982 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:25.425560 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1766d5b3-ac6b-4995-87fe-5f2a6d3fe3f2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196648 Aug 10 13:31:25.427001 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 407/809] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 10 13:31:25 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:26.752385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-cbe4a687-f522-459e-879b-6beb3ea8f524 req-2b2817c4-e7fb-4e81-8c40-ce3399eaf976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99c255d-d210-4be5-9251-441c5103a1ac", "tag": "39c4c2d7-4497-410a-8487-c926c213dd87"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:26.762369 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cbe4a687-f522-459e-879b-6beb3ea8f524 req-2b2817c4-e7fb-4e81-8c40-ce3399eaf976 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:26.762851 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cbe4a687-f522-459e-879b-6beb3ea8f524 req-2b2817c4-e7fb-4e81-8c40-ce3399eaf976 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:26.763284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cbe4a687-f522-459e-879b-6beb3ea8f524 req-2b2817c4-e7fb-4e81-8c40-ce3399eaf976 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:26.774376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-cbe4a687-f522-459e-879b-6beb3ea8f524 req-2b2817c4-e7fb-4e81-8c40-ce3399eaf976 service nova] Creating event network-changed:39c4c2d7-4497-410a-8487-c926c213dd87 for instance a99c255d-d210-4be5-9251-441c5103a1ac on hv-cinder-83602 Aug 10 13:31:26.781473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-cbe4a687-f522-459e-879b-6beb3ea8f524 req-2b2817c4-e7fb-4e81-8c40-ce3399eaf976 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031797 Aug 10 13:31:26.781473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 403/810] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:30.506830 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:30.509031 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:30.515800 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:30.516163 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:30.516601 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:30.517409 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:30.522498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:30.522498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:30.565937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3b7d0ed9-1b55-4c2c-85c4-cfe22f3ca638 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063733 Aug 10 13:31:30.566509 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 408/811] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:30 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:30.578557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:30.579139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:30.585843 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:30.586329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:30.586773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:30.587467 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:30.587928 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:30.588357 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:30.616249 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c1b4e038-e445-4d99-b762-f37b9058c5ad tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/f4374824-5157-4288-a1c6-eb74b167da22" status: 200 len: 194 microversion: 2.1 time: 0.042632 Aug 10 13:31:30.616847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 404/812] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Aug 10 13:31:30 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/f4374824-5157-4288-a1c6-eb74b167da22 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:30.783782 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1696493206"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:30.784518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:30.790527 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:30.791005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:30.791437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:30.792134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:30.792572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:30.793008 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:30.926706 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.network.security_group_api [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Removing security group d80b23fc-9246-4241-a31d-3b97783b2e10 from port 273e8b95-1ed6-4f94-a5b2-d256242f35e1 Aug 10 13:31:31.372878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-176ff01c-0fc0-40a8-ba71-c84403a96296 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "POST /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/action" status: 202 len: 0 microversion: 2.1 time: 0.593553 Aug 10 13:31:31.375278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 409/813] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:31:30 2022] POST /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:31:31.388065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-bc77cae1-e33b-4385-ac1a-f8f22da8e769 req-78db4894-3c8e-42ec-bca9-60f6ea6a5ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c04cd31-0203-46ab-bee8-1cdaf27c3e34", "tag": "273e8b95-1ed6-4f94-a5b2-d256242f35e1"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:31.399025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-bc77cae1-e33b-4385-ac1a-f8f22da8e769 req-78db4894-3c8e-42ec-bca9-60f6ea6a5ca0 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:31.400325 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-bc77cae1-e33b-4385-ac1a-f8f22da8e769 req-78db4894-3c8e-42ec-bca9-60f6ea6a5ca0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:31.400922 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-bc77cae1-e33b-4385-ac1a-f8f22da8e769 req-78db4894-3c8e-42ec-bca9-60f6ea6a5ca0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:31.415690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-bc77cae1-e33b-4385-ac1a-f8f22da8e769 req-78db4894-3c8e-42ec-bca9-60f6ea6a5ca0 service nova] Creating event network-changed:273e8b95-1ed6-4f94-a5b2-d256242f35e1 for instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 on hv-cinder-83602 Aug 10 13:31:31.424454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-bc77cae1-e33b-4385-ac1a-f8f22da8e769 req-78db4894-3c8e-42ec-bca9-60f6ea6a5ca0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039942 Aug 10 13:31:31.425718 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 405/814] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:32.238726 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "194b7add-deb8-40ef-8ee5-7d0bca5e455e"}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:32.241788 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:32.247925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:32.248647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:32.249522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:32.250907 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:32.251875 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:32.252551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:32.921504 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-475b3474-07be-44e3-ad3e-d4e2dc0ae70c tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "POST /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687150 Aug 10 13:31:32.923532 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 410/815] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:31:32 2022] POST /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:32.991916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:32.992622 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:33.000314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:33.000941 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:33.001502 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:33.002310 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:33.002862 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:33.003493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:33.099863 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lazy-loading 'services' on Instance uuid 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:33.363823 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b063a751-4c5c-4e23-b148-1d1f17958417 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments/0cc09d17-b492-4959-81c8-22dd226cc15a" status: 202 len: 0 microversion: 2.1 time: 0.376109 Aug 10 13:31:33.364738 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 406/816] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:31:32 2022] DELETE /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments/0cc09d17-b492-4959-81c8-22dd226cc15a => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:31:33.381047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:33.383341 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:33.390759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:33.390759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:33.390759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:33.391490 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:33.391949 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:33.392655 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:33.425885 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f7812206-29cc-4f00-bc67-783ea19c1a15 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056241 Aug 10 13:31:33.426469 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 411/817] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:33 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:33.446917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-ce055ba8-fa35-48bc-acde-db59dd6bedc2 req-6fcb6372-87b9-4f83-99a8-c22198644090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c04cd31-0203-46ab-bee8-1cdaf27c3e34", "tag": "273e8b95-1ed6-4f94-a5b2-d256242f35e1"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:33.457976 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-ce055ba8-fa35-48bc-acde-db59dd6bedc2 req-6fcb6372-87b9-4f83-99a8-c22198644090 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:33.458542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-ce055ba8-fa35-48bc-acde-db59dd6bedc2 req-6fcb6372-87b9-4f83-99a8-c22198644090 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:33.459180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-ce055ba8-fa35-48bc-acde-db59dd6bedc2 req-6fcb6372-87b9-4f83-99a8-c22198644090 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:33.475291 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-ce055ba8-fa35-48bc-acde-db59dd6bedc2 req-6fcb6372-87b9-4f83-99a8-c22198644090 service nova] Creating event network-changed:273e8b95-1ed6-4f94-a5b2-d256242f35e1 for instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 on hv-cinder-83602 Aug 10 13:31:33.480712 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-ce055ba8-fa35-48bc-acde-db59dd6bedc2 req-6fcb6372-87b9-4f83-99a8-c22198644090 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037654 Aug 10 13:31:33.485214 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 407/818] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:34.438473 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:34.440615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:34.447051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:34.447531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:34.447961 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:34.448650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:34.449171 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:34.449594 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:34.474901 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:34.479450 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-614fb540-8952-4d66-a2dc-d0265a94171a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Aug 10 13:31:34.480021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 412/819] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:34 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:35.492698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:35.494964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:35.501622 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:35.502340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:35.502550 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:35.503249 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:35.503759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:35.504133 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:35.528847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:35.534849 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4e0031d4-f74e-4dfe-88f7-ca9d8cd079ff tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Aug 10 13:31:35.535413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 408/820] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:35 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:36.547692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:36.549989 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:36.556799 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:36.557313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:36.557748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:36.558439 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:36.558894 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:36.559324 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:36.589005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4e123d12-a6a4-4cd6-90ca-0d9a13ad47b8 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045950 Aug 10 13:31:36.589603 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 413/821] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:36 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:37.602018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:37.604141 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:37.611882 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:37.612391 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:37.612825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:37.613553 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:37.614071 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:37.614494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:37.644628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-807119f1-17db-4bbc-b0f5-b03a0dca950e tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046587 Aug 10 13:31:37.645245 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 409/822] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:37 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:38.658119 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:38.660625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:38.668042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:38.668536 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:38.669143 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:38.670562 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:38.671010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:38.671482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:38.702119 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-38962e8f-4232-40e0-86db-4401d7df18fb tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048931 Aug 10 13:31:38.702698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 414/823] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:38 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:39.715130 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:39.718239 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:39.724412 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:39.728355 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:39.728355 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:39.728355 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:39.728355 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:39.728720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:39.758762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d552dcdd-da77-4f40-b141-a244100c06c2 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048265 Aug 10 13:31:39.759316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 410/824] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:39 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:40.489298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:40.491505 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:40.497914 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:40.499553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:40.499946 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:40.500637 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:40.501191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:40.501617 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:40.532625 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f7e601f1-1384-4924-a40b-ee9f86ef536f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047253 Aug 10 13:31:40.533401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 415/825] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:40 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:40.685751 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:40.686297 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:40.693158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:40.693652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:40.694098 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:40.694802 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:40.695915 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:40.696719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:40.730988 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4bf75b3b-0ffb-4cf4-bbc6-bb17d4582c47 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/f4374824-5157-4288-a1c6-eb74b167da22" status: 200 len: 194 microversion: 2.1 time: 0.049305 Aug 10 13:31:40.737607 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 411/826] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Aug 10 13:31:40 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/f4374824-5157-4288-a1c6-eb74b167da22 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:40.742474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:40.743194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:40.758070 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:40.758826 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:40.759269 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:40.760182 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:40.760648 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:40.761108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:40.771311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:40.773618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:40.784760 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:40.790889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:40.790889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:40.790889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:40.790889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:40.791285 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:40.823356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ea33f5cb-ac27-4bff-ad54-c69123ea1777 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056014 Aug 10 13:31:40.824223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 412/827] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:40 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:31:40.852174 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lazy-loading 'services' on Instance uuid d2690bd0-5fca-4960-b86c-ca587fd564ec {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:41.054108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d356eb84-92ec-4655-9140-b00a03a6efef tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/f4374824-5157-4288-a1c6-eb74b167da22" status: 202 len: 0 microversion: 2.1 time: 0.315319 Aug 10 13:31:41.054845 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 416/828] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:31:40 2022] DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/f4374824-5157-4288-a1c6-eb74b167da22 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:31:41.836438 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:41.838730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:41.845622 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:41.846101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:41.846729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:41.847645 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:41.848192 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:41.848506 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:41.877719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-aad6a6a9-88cf-4807-9d3e-b712fc263c48 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045148 Aug 10 13:31:41.878198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 413/829] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:41 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:31:41.890103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:41.890688 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:41.897321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:41.897805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:41.898305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:41.898998 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:41.899451 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:41.899877 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:41.979325 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] HTTP exception thrown: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 is not attached to volume 0cc09d17-b492-4959-81c8-22dd226cc15a Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Request method failure captured: Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: DELETE /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments/0cc09d17-b492-4959-81c8-22dd226cc15a HTTP/1.1 Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87KP6_nvoAOEaK5vFi3tB1TRYULChQLzNR8cmG_EyA-BzBWc_ZNn6S90g7ZZtrgSLKUrOHuz7gFyK773UYdm8Z25HHj7yz3JvtKwa2TTMfwLkmlJCrLcwHXFIfMdtTOZqBCEAgLdr3LVUifdWNcWqIaYsd_IF4QcU4LggEoJozaScxw Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 6ccc46e1ccb04fb386367a71ad13f008 Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-TestMinimumBasicScenario-1011352360 Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:31:41.981734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ccc46e1ccb04fb386367a71ad13f008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ccc46e1ccb04fb386367a71ad13f008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6ccc46e1ccb04fb386367a71ad13f008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6ccc46e1ccb04fb386367a71ad13f008", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-TestMinimumBasicScenario-1011352360 Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 6ccc46e1ccb04fb386367a71ad13f008 Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1011352360 Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-TestMinimumBasicScenario-1011352360-project Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 379f81ea933d4207865a8d1f299b5634 Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-TestMinimumBasicScenario-1011352360-project Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:31:41.987078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 is not attached to volume 0cc09d17-b492-4959-81c8-22dd226cc15a Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'server_id': '0c04cd31-0203-46ab-bee8-1cdaf27c3e34', 'id': '0cc09d17-b492-4959-81c8-22dd226cc15a'} Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0cc09d17-b492-4959-81c8-22dd226cc15a. Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:41.987838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 is not attached to volume 0cc09d17-b492-4959-81c8-22dd226cc15a Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 is not attached to volume 0cc09d17-b492-4959-81c8-22dd226cc15a Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.989042 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Returning 404 to user: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 is not attached to volume 0cc09d17-b492-4959-81c8-22dd226cc15a {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:41.990118 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6295c3de-dbdd-4d4f-88b0-38eb54295155 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments/0cc09d17-b492-4959-81c8-22dd226cc15a" status: 404 len: 154 microversion: 2.1 time: 0.098497 Aug 10 13:31:41.990118 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 417/830] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:31:41 2022] DELETE /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34/os-volume_attachments/0cc09d17-b492-4959-81c8-22dd226cc15a => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:31:43.347011 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:43.347508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:43.350017 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:43.354916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:43.355489 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:43.355992 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:43.356752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:43.357297 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:43.357845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:43.374265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:43.374750 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:43.382403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:43.382895 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:43.383337 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:43.384070 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:43.384523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:43.384986 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:43.391134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0458abb6-3d3e-422e-a450-d25f2487b2db tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/194b7add-deb8-40ef-8ee5-7d0bca5e455e" status: 200 len: 194 microversion: 2.1 time: 0.047868 Aug 10 13:31:43.391134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 414/831] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Aug 10 13:31:43 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/194b7add-deb8-40ef-8ee5-7d0bca5e455e => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:31:43.401343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:43.401771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:43.408693 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:43.409470 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:43.415160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:43.415160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:43.415160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:43.415160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:43.415539 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:31:43.495061 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lazy-loading 'services' on Instance uuid d2690bd0-5fca-4960-b86c-ca587fd564ec {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:43.666785 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-251cea95-ee9e-4681-9637-19fbdce5f4f4 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 204 len: 0 microversion: 2.1 time: 0.296259 Aug 10 13:31:43.667667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 418/832] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:31:43 2022] DELETE /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:31:43.673324 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3258e61a-286e-4f8d-a1fc-f333a00b89f9 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/194b7add-deb8-40ef-8ee5-7d0bca5e455e" status: 202 len: 0 microversion: 2.1 time: 0.276007 Aug 10 13:31:43.676921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 415/833] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:31:43 2022] DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments/194b7add-deb8-40ef-8ee5-7d0bca5e455e => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:31:43.677709 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:43.678419 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:43.685083 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:43.685577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:43.686017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:43.687585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:43.688080 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:43.688569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:43.822446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:43.832913 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f7fab64f-2b09-47e1-b669-d8a8f397d2b0 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1553 microversion: 2.1 time: 0.158254 Aug 10 13:31:43.841819 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 419/834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:43 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:44.853933 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:44.854659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:44.862250 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:44.862739 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:44.863181 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:44.863931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:44.864469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:44.864899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:45.008207 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:45.016436 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9957473b-7227-4a73-96a4-9dd287c43a35 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1553 microversion: 2.1 time: 0.166793 Aug 10 13:31:45.017010 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 416/835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:44 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:46.037759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:46.038378 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:46.044789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:46.045307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:46.045746 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:46.046683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:46.047357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:46.047796 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:46.253533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:46.261061 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-05d32451-466b-4344-8f89-119af13da81a tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1553 microversion: 2.1 time: 0.227454 Aug 10 13:31:46.261652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 420/836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:46 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:46.692545 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-958153846", "imageRef": "40592cb3-5100-454d-9773-916457cc8d4a", "flavorRef": "452"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:46.728199 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-4bdfce3d-4df9-45e8-8910-c5d6204e5dbd req-dcbfe54e-bdb6-4aae-8b32-0459036264b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c04cd31-0203-46ab-bee8-1cdaf27c3e34", "name": "network-vif-deleted", "tag": "273e8b95-1ed6-4f94-a5b2-d256242f35e1"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:46.739274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4bdfce3d-4df9-45e8-8910-c5d6204e5dbd req-dcbfe54e-bdb6-4aae-8b32-0459036264b6 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:46.739654 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4bdfce3d-4df9-45e8-8910-c5d6204e5dbd req-dcbfe54e-bdb6-4aae-8b32-0459036264b6 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:46.740083 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-4bdfce3d-4df9-45e8-8910-c5d6204e5dbd req-dcbfe54e-bdb6-4aae-8b32-0459036264b6 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:46.751086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] validate_networks() for None {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:31:46.751960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-4bdfce3d-4df9-45e8-8910-c5d6204e5dbd req-dcbfe54e-bdb6-4aae-8b32-0459036264b6 service nova] Creating event network-vif-deleted:273e8b95-1ed6-4f94-a5b2-d256242f35e1 for instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 on hv-cinder-83602 Aug 10 13:31:46.756968 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-4bdfce3d-4df9-45e8-8910-c5d6204e5dbd req-dcbfe54e-bdb6-4aae-8b32-0459036264b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032895 Aug 10 13:31:46.757610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 421/837] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:46.977485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:46.979973 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:46.987024 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:46.987605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:46.988123 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:46.988894 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:46.989447 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:46.990003 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.021610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5ae13395-2564-4736-8d76-6a34797a7aa8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048620 Aug 10 13:31:47.022180 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 422/838] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:46 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:31:47.055155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:31:47.055580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:31:47.056055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:31:47.056513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:31:47.056928 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:31:47.070087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.070720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.071273 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.071996 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.072445 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.072864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.092388 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Getting quotas for project b72df548c9f74b06858740e09546179b. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:31:47.098932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Getting quotas for user a37b3d41c18541828b0aff71b4419bb8 and project b72df548c9f74b06858740e09546179b. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:31:47.111145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:31:47.114454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40592cb3-5100-454d-9773-916457cc8d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:31:47.149026 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:47.151245 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:47.158460 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.159201 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.159651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.160401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.160867 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.161326 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.192714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9728e214-c3a7-4e01-b133-75654bd5f760 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047626 Aug 10 13:31:47.193334 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 423/839] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:31:47 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 13:31:47.233110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-01fab5b5-eacf-46c9-b5d3-22866140dcbd tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544559 Aug 10 13:31:47.234353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 417/840] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:31:47.245517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-704ac089-b052-4be9-bb41-e18346e664d3 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:47.246188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-704ac089-b052-4be9-bb41-e18346e664d3 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:47.255735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:47.257131 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:47.264601 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.265268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.266003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.266814 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.267379 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.267913 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.307940 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-704ac089-b052-4be9-bb41-e18346e664d3 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:47.310650 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:31:47.315459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-704ac089-b052-4be9-bb41-e18346e664d3 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1214 microversion: 2.1 time: 0.073710 Aug 10 13:31:47.316319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 424/841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:47 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:47.333582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:47.334333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:47.340862 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.341461 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.342015 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.343319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.343858 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.344298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.378010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.378507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.378951 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.379406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lazy-loading 'fault' on Instance uuid 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:47.422717 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379f81ea933d4207865a8d1f299b5634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc46e1ccb04fb386367a71ad13f008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:47.430425 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-80811cab-0bef-4966-b81d-eecfbccf56fd tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 200 len: 1347 microversion: 2.1 time: 0.101198 Aug 10 13:31:47.430980 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 425/842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:47 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 1347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:47.637699 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5d816e37-5807-4afc-8f4d-8376317f7637 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 204 len: 0 microversion: 2.1 time: 0.385401 Aug 10 13:31:47.641609 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 418/843] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:31:47 2022] DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:31:47.662867 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:47.663776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:47.669824 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.670303 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.670947 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.671949 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:47.672228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:47.672640 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:47.806782 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:47.815037 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c740b0a3-ba9a-4ec9-8e6b-4c523fba22da tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1672 microversion: 2.1 time: 0.169641 Aug 10 13:31:47.815620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 426/844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:47 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:31:48.336132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-afd2183d-ec84-47f1-904a-7be62f013d66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:48.336822 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-afd2183d-ec84-47f1-904a-7be62f013d66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:48.388829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-afd2183d-ec84-47f1-904a-7be62f013d66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:48.396667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-afd2183d-ec84-47f1-904a-7be62f013d66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1214 microversion: 2.1 time: 0.064794 Aug 10 13:31:48.397251 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 419/845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:48 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:48.454128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:48.454734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] [instance: 0c04cd31-0203-46ab-bee8-1cdaf27c3e34] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:48.457114 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:48.461830 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:48.462433 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:48.462879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:48.463570 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:48.464023 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:48.464446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:48.480045 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] HTTP exception thrown: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 could not be found. Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Request method failure captured: Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 HTTP/1.1 Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87KP6_nvoAOEaK5vFi3tB1TRYULChQLzNR8cmG_EyA-BzBWc_ZNn6S90g7ZZtrgSLKUrOHuz7gFyK773UYdm8Z25HHj7yz3JvtKwa2TTMfwLkmlJCrLcwHXFIfMdtTOZqBCEAgLdr3LVUifdWNcWqIaYsd_IF4QcU4LggEoJozaScxw Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 6ccc46e1ccb04fb386367a71ad13f008 Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-TestMinimumBasicScenario-1011352360 Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:31:48.481765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ccc46e1ccb04fb386367a71ad13f008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ccc46e1ccb04fb386367a71ad13f008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6ccc46e1ccb04fb386367a71ad13f008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6ccc46e1ccb04fb386367a71ad13f008", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-TestMinimumBasicScenario-1011352360 Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 6ccc46e1ccb04fb386367a71ad13f008 Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1011352360 Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-TestMinimumBasicScenario-1011352360-project Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 379f81ea933d4207865a8d1f299b5634 Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-TestMinimumBasicScenario-1011352360-project Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 could not be found. Aug 10 13:31:48.494357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '0c04cd31-0203-46ab-bee8-1cdaf27c3e34'} Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 could not be found. Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:48.495240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 could not be found. Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 could not be found. Aug 10 13:31:48.496710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:48.498189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Returning 404 to user: Instance 0c04cd31-0203-46ab-bee8-1cdaf27c3e34 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:48.498189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-18e41191-2890-42d1-a9c1-ddd392652174 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34" status: 404 len: 111 microversion: 2.1 time: 0.033464 Aug 10 13:31:48.498189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 427/846] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:48 2022] GET /compute/v2.1/servers/0c04cd31-0203-46ab-bee8-1cdaf27c3e34 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:31:48.498443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-36818d88-6021-4a46-9d55-b1af3bf795c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] Calling method '.version_select at 0x7ff6aa09da60>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:48.569360 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-36818d88-6021-4a46-9d55-b1af3bf795c5 tempest-TestMinimumBasicScenario-1011352360 tempest-TestMinimumBasicScenario-1011352360-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-626095839" status: 202 len: 0 microversion: 2.1 time: 0.081177 Aug 10 13:31:48.569946 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 420/847] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Aug 10 13:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-626095839 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:31:48.836398 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:48.837025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:48.844606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:48.845152 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:48.845596 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:48.846363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:48.846852 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:48.847278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:48.986111 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:48.993887 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fd9799ec-8f87-4d83-ba6e-3ac59d1c0008 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1672 microversion: 2.1 time: 0.161379 Aug 10 13:31:48.994460 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 428/848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:48 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:49.418305 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:49.418918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:49.426023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:49.426508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:49.427068 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:49.427756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:49.428209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:49.428634 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:49.491826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:49.500284 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-14c3494a-a7fc-49ce-9a99-cfeb7326a91c tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1218 microversion: 2.1 time: 0.086273 Aug 10 13:31:49.500859 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 421/849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:49 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:50.016173 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:50.016842 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:50.023620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:50.024359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:50.024810 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:50.025683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:50.026139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:50.026733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:50.031960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:50.238070 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:50.245806 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d0123707-e5d4-4046-94ce-39003d1f83a1 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1672 microversion: 2.1 time: 0.234030 Aug 10 13:31:50.246618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 429/850] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:50 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:50.521752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:50.522678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:50.531279 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:50.532042 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:50.532675 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:50.533595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:50.534321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:50.534753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:50.655146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:50.667918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-234f2e75-7de8-4211-9768-c61e81416039 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1284 microversion: 2.1 time: 0.150041 Aug 10 13:31:50.668741 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 422/851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:50 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:50.958110 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-29e9da6f-1d1c-45b1-b9fe-67daec003063 req-ddb77137-6e5b-44d6-b611-2e9aea172010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2690bd0-5fca-4960-b86c-ca587fd564ec", "name": "network-vif-deleted", "tag": "f68047cb-8eb7-4646-831d-ac7ecea60a98"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:50.964809 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-29e9da6f-1d1c-45b1-b9fe-67daec003063 req-ddb77137-6e5b-44d6-b611-2e9aea172010 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:50.965335 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-29e9da6f-1d1c-45b1-b9fe-67daec003063 req-ddb77137-6e5b-44d6-b611-2e9aea172010 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:50.965950 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-29e9da6f-1d1c-45b1-b9fe-67daec003063 req-ddb77137-6e5b-44d6-b611-2e9aea172010 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:50.999774 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-29e9da6f-1d1c-45b1-b9fe-67daec003063 req-ddb77137-6e5b-44d6-b611-2e9aea172010 service nova] Creating event network-vif-deleted:f68047cb-8eb7-4646-831d-ac7ecea60a98 for instance d2690bd0-5fca-4960-b86c-ca587fd564ec on hv-cinder-83602 Aug 10 13:31:51.024088 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-29e9da6f-1d1c-45b1-b9fe-67daec003063 req-ddb77137-6e5b-44d6-b611-2e9aea172010 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062846 Aug 10 13:31:51.024088 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 430/852] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:51.268447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:51.269090 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:51.286747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:51.287758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:51.288389 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:51.289731 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:51.290387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:51.290984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:51.363172 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:51.363706 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:51.364486 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:51.364938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lazy-loading 'fault' on Instance uuid d2690bd0-5fca-4960-b86c-ca587fd564ec {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:31:51.425584 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ace2374550e40ce812407406c262ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3070abbdec34c779d4bd382b2bb1697', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:51.435503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1fbb1adc-1cf6-4fac-a262-99e948c4fd9e tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 200 len: 1326 microversion: 2.1 time: 0.172309 Aug 10 13:31:51.436667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 423/853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:51 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:51.691855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:51.692954 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:51.709245 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:51.713023 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:51.713981 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:51.716466 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:51.718557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:51.720632 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:52.029497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:52.041134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c8da7cdc-3027-4b3b-b127-8736b8493b37 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1314 microversion: 2.1 time: 0.354338 Aug 10 13:31:52.041976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 431/854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:51 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:52.456485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:52.457220 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:52.467344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:52.468719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:52.469494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:52.470489 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:52.471141 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:52.471931 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:52.492571 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] HTTP exception thrown: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Request method failure captured: Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec HTTP/1.1 Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HHxRul-kcZfukl7Vlopibkt-oH6ume0jKmZHoGxJaW4-Np6O2qjVmJeXy_5Of51BFkQqLE4BrVrV0hJXYjQd2f1v9D7ZcRy4SVDd_G3-_A4GOmNEw706QWjSbv41_swnvOnWjrti6xPX-IzfTFEiwX8jCra9tPVOAktgx0pntOAVA Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:31:52.494806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3070abbdec34c779d4bd382b2bb1697", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 0ace2374550e40ce812407406c262ac5 Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:52.496240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'd2690bd0-5fca-4960-b86c-ca587fd564ec'} Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:52.497144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:52.499944 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:52.503429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Returning 404 to user: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:52.506058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4d59eb3a-fe72-42dc-b6d7-2ee895a56903 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 404 len: 111 microversion: 2.1 time: 0.053964 Aug 10 13:31:52.510584 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 424/855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:52 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:31:52.516307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-af5c6829-9c5a-4c8f-aa99-887f9b6299c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '.version_select at 0x7ff6a3706700>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:52.660491 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-af5c6829-9c5a-4c8f-aa99-887f9b6299c3 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124246939" status: 202 len: 0 microversion: 2.1 time: 0.148751 Aug 10 13:31:52.661160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 432/856] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 10 13:31:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124246939 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:31:53.068624 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:53.069985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:53.075520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:53.076106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:53.076623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:53.078146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:53.078662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:53.079149 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:53.148144 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-be351c7b-c5b2-4959-b27e-db3634db47ef req-43d881d0-7d1e-4592-8540-b4440df1c3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e911432d-1e92-4be9-aafd-3d73d7856531", "tag": "3759549e-ec20-4693-b3c8-dd4e32d1cacb"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:53.162690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-be351c7b-c5b2-4959-b27e-db3634db47ef req-43d881d0-7d1e-4592-8540-b4440df1c3c1 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:53.163509 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-be351c7b-c5b2-4959-b27e-db3634db47ef req-43d881d0-7d1e-4592-8540-b4440df1c3c1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:53.164175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-be351c7b-c5b2-4959-b27e-db3634db47ef req-43d881d0-7d1e-4592-8540-b4440df1c3c1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:53.214197 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-be351c7b-c5b2-4959-b27e-db3634db47ef req-43d881d0-7d1e-4592-8540-b4440df1c3c1 service nova] Creating event network-changed:3759549e-ec20-4693-b3c8-dd4e32d1cacb for instance e911432d-1e92-4be9-aafd-3d73d7856531 on hv-cinder-83602 Aug 10 13:31:53.223789 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-be351c7b-c5b2-4959-b27e-db3634db47ef req-43d881d0-7d1e-4592-8540-b4440df1c3c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081171 Aug 10 13:31:53.224730 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 433/857] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:31:53.299688 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:53.319698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b6759ae8-6d01-43ad-9298-e8e93e19b7fb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1314 microversion: 2.1 time: 0.258177 Aug 10 13:31:53.321520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 425/858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:53 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:54.342513 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:54.343320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:54.349628 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:54.350296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:54.350731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:54.351541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:54.352001 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:54.352423 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:54.595338 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:54.603037 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8a08f4ef-5881-4929-98de-5ec195f9bfef tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1314 microversion: 2.1 time: 0.265517 Aug 10 13:31:54.603620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 434/859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:54 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:55.624295 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:55.625167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:55.633676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:55.634056 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:55.634595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:55.636051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:55.636614 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:55.637230 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:55.642716 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:55.796553 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:55.804149 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4cba8f16-503f-4e5c-8607-76aa9c4268f6 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1314 microversion: 2.1 time: 0.183876 Aug 10 13:31:55.804927 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 426/860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:55 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:56.775637 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:56.776213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:56.784209 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:56.784693 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:56.785374 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:56.786086 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:56.786542 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:56.786969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:56.804728 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] HTTP exception thrown: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Request method failure captured: Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec HTTP/1.1 Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HHxRul-kcZfukl7Vlopibkt-oH6ume0jKmZHoGxJaW4-Np6O2qjVmJeXy_5Of51BFkQqLE4BrVrV0hJXYjQd2f1v9D7ZcRy4SVDd_G3-_A4GOmNEw706QWjSbv41_swnvOnWjrti6xPX-IzfTFEiwX8jCra9tPVOAktgx0pntOAVA Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:31:56.806530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3070abbdec34c779d4bd382b2bb1697", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 0ace2374550e40ce812407406c262ac5 Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.807855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'd2690bd0-5fca-4960-b86c-ca587fd564ec'} Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:56.808653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.809931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.811253 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Returning 404 to user: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:56.811253 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-477b497b-3f39-4016-b37a-a0461f13a7a8 tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 404 len: 111 microversion: 2.1 time: 0.036989 Aug 10 13:31:56.816808 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:56.817600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: d2690bd0-5fca-4960-b86c-ca587fd564ec] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:56.823273 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 435/861] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:31:56 2022] DELETE /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:31:56.828650 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:56.829176 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:56.829621 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:56.830871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:56.830871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:56.831177 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:56.835025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:56.835742 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:56.841854 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:56.842344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:56.843555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:56.844305 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:56.844769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:56.845247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:56.845667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] HTTP exception thrown: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Request method failure captured: Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec HTTP/1.1 Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HHxRul-kcZfukl7Vlopibkt-oH6ume0jKmZHoGxJaW4-Np6O2qjVmJeXy_5Of51BFkQqLE4BrVrV0hJXYjQd2f1v9D7ZcRy4SVDd_G3-_A4GOmNEw706QWjSbv41_swnvOnWjrti6xPX-IzfTFEiwX8jCra9tPVOAktgx0pntOAVA Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:31:56.847222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3070abbdec34c779d4bd382b2bb1697", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 0ace2374550e40ce812407406c262ac5 Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.848825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'd2690bd0-5fca-4960-b86c-ca587fd564ec'} Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:56.852371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. Aug 10 13:31:56.853869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:31:56.855163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Returning 404 to user: Instance d2690bd0-5fca-4960-b86c-ca587fd564ec could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:56.855163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-bed1a45f-5384-4ded-b3cc-9e8f0293ff0a tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec" status: 404 len: 111 microversion: 2.1 time: 0.035691 Aug 10 13:31:56.855163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 427/862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:56 2022] GET /compute/v2.1/servers/d2690bd0-5fca-4960-b86c-ca587fd564ec => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:31:56.989928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:56.997858 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0dabfa71-fb0d-4869-a9e1-f38ba1cc1330 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1314 microversion: 2.1 time: 0.173479 Aug 10 13:31:56.998429 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 436/863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:56 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:58.021951 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:58.022694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:58.024680 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:58.036934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:58.036934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:58.036934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:58.036934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:58.037493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:58.037493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:58.155401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:58.160235 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:58.164652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:58.175160 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:58.176684 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:58.177533 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:58.178699 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:58.179465 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:58.180527 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:58.202668 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] HTTP exception thrown: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Request method failure captured: Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: DELETE /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 HTTP/1.1 Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HHxRul-kcZfukl7Vlopibkt-oH6ume0jKmZHoGxJaW4-Np6O2qjVmJeXy_5Of51BFkQqLE4BrVrV0hJXYjQd2f1v9D7ZcRy4SVDd_G3-_A4GOmNEw706QWjSbv41_swnvOnWjrti6xPX-IzfTFEiwX8jCra9tPVOAktgx0pntOAVA Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:31:58.204817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3070abbdec34c779d4bd382b2bb1697", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 0ace2374550e40ce812407406c262ac5 Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.206186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280'} Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:58.206897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.208063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.210769 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Returning 404 to user: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:58.211821 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f8651a82-0669-445e-adb9-1d3f28c490fe tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 404 len: 111 microversion: 2.1 time: 0.066777 Aug 10 13:31:58.212901 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 437/864] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:31:58 2022] DELETE /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:31:58.226695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:58.227646 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] [instance: 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:58.238685 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:58.239375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:58.239708 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:58.240444 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:58.240905 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:58.241388 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:58.256654 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] HTTP exception thrown: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Request method failure captured: Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 HTTP/1.1 Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HHxRul-kcZfukl7Vlopibkt-oH6ume0jKmZHoGxJaW4-Np6O2qjVmJeXy_5Of51BFkQqLE4BrVrV0hJXYjQd2f1v9D7ZcRy4SVDd_G3-_A4GOmNEw706QWjSbv41_swnvOnWjrti6xPX-IzfTFEiwX8jCra9tPVOAktgx0pntOAVA Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:31:58.258252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3070abbdec34c779d4bd382b2bb1697"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3070abbdec34c779d4bd382b2bb1697", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: f3070abbdec34c779d4bd382b2bb1697 Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1428440790 Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 0ace2374550e40ce812407406c262ac5 Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeTestJSON-1428440790-project Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.259524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280'} Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:58.260266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. Aug 10 13:31:58.261485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:31:58.263296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] Returning 404 to user: Instance 5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:58.263296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-84f6944f-279b-468e-8f82-18c5414f7e2f tempest-AttachVolumeTestJSON-1428440790 tempest-AttachVolumeTestJSON-1428440790-project] 10.222.0.40 "GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280" status: 404 len: 111 microversion: 2.1 time: 0.040951 Aug 10 13:31:58.263469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:58.263585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 438/865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:58 2022] GET /compute/v2.1/servers/5b0c7a9c-6fb1-4e3b-8a6b-d6419f987280 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:31:58.272849 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e949141b-7037-42c2-9d6f-92cc722b9c85 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1314 microversion: 2.1 time: 0.251961 Aug 10 13:31:58.273675 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 428/866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:58 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:58.413175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-01600e4e-c0a1-4b27-bf7f-7e9eacc7a5de req-686fefd5-875c-4a0f-ac19-319a274c5a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e911432d-1e92-4be9-aafd-3d73d7856531", "name": "network-vif-plugged", "status": "completed", "tag": "3759549e-ec20-4693-b3c8-dd4e32d1cacb"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:58.428799 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-01600e4e-c0a1-4b27-bf7f-7e9eacc7a5de req-686fefd5-875c-4a0f-ac19-319a274c5a00 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:58.434696 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-01600e4e-c0a1-4b27-bf7f-7e9eacc7a5de req-686fefd5-875c-4a0f-ac19-319a274c5a00 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:58.435313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-01600e4e-c0a1-4b27-bf7f-7e9eacc7a5de req-686fefd5-875c-4a0f-ac19-319a274c5a00 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:58.448615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-01600e4e-c0a1-4b27-bf7f-7e9eacc7a5de req-686fefd5-875c-4a0f-ac19-319a274c5a00 service nova] Creating event network-vif-plugged:3759549e-ec20-4693-b3c8-dd4e32d1cacb for instance e911432d-1e92-4be9-aafd-3d73d7856531 on hv-cinder-83602 Aug 10 13:31:58.455084 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-01600e4e-c0a1-4b27-bf7f-7e9eacc7a5de req-686fefd5-875c-4a0f-ac19-319a274c5a00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049613 Aug 10 13:31:58.455834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 439/867] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:59.295019 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:59.295789 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:31:59.299459 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=8 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:59.303683 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:59.304278 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:59.304812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:59.305631 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:31:59.306353 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:31:59.306871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:31:59.457503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:31:59.465077 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-87f30e26-f59d-4625-b17c-88f6f3327af4 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1314 microversion: 2.1 time: 0.174002 Aug 10 13:31:59.465657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 429/868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:31:59 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:00.488480 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:00.489748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:00.496126 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:00.496612 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:00.497062 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:00.497758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:00.498203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:00.498827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:00.648601 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:00.674319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-12a77e34-9ff8-44c9-be81-725d7157021a tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1314 microversion: 2.1 time: 0.190489 Aug 10 13:32:00.676460 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 440/869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:00 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:01.700465 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:01.701783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:01.708875 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:01.709385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:01.709829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:01.711259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:01.711883 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:01.712481 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:01.990260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:01.995530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1ed36125-b856-4893-afd9-065351fe8c68 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1463 microversion: 2.1 time: 0.302045 Aug 10 13:32:01.996485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 430/870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:01 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:02.041022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:02.041622 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:02.049447 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:02.049930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:02.050361 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:02.051046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:02.051530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:02.057171 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:02.082877 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:32:02.305811 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-94dbbdd2-a65a-474f-afd9-ffb66d8ce691 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 204 len: 0 microversion: 2.1 time: 0.268378 Aug 10 13:32:02.309820 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 441/871] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:32:02 2022] DELETE /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:32:02.315920 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:02.316520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:02.322585 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:02.323074 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:02.323517 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:02.324216 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:02.324683 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:02.325145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:02.483486 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:02.491312 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-400d10cd-999f-4d35-9806-6cfd5e364cb9 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1469 microversion: 2.1 time: 0.180407 Aug 10 13:32:02.491897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 431/872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:02 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:03.511997 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:03.512794 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:03.519394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:03.519868 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:03.524418 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:03.524418 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:03.524418 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:03.524418 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:03.654536 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:03.662681 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-58dbe8f7-54ad-4077-9368-4d2afcf1f3bb tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1469 microversion: 2.1 time: 0.154722 Aug 10 13:32:03.663254 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 442/873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:03 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:04.189695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-36ea29a6-aa4c-4b03-922f-69cb83b654a0 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Action: 'create', calling method: .version_select at 0x7ff6a372fdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-502660781", "metadata": {"Type": "work"}}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-36ea29a6-aa4c-4b03-922f-69cb83b654a0 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Request method failure captured: Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 121 Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87NTLOt4m39P1b1Ar7j5448X5fYQBbbl1vwzWNjRmAaV4kYh1H4JwNvHDqhI_NIeotvA_ei2rF-AMA22lCxGIDpS-3GAMmE_ECT0EzpiL1WwGU5QBVBXrHKfveP46FwBu9G-H5kYgM57I-V3B9uR9aUMIYYOSuWxkPDqSugeASjwhK8 Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:04.197947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3d92122eca2433dab79cfa4d9601159", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 5739e405875f414abdc70552a3c073eb Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-502660781", "metadata": {"Type": "work"}}} Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: Aug 10 13:32:04.199709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-502660781', 'metadata': {'Type': 'work'}}}} Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:04.200674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:32:04.202209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:32:04.204440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:32:04.204440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.204440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-36ea29a6-aa4c-4b03-922f-69cb83b654a0 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:04.204440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-36ea29a6-aa4c-4b03-922f-69cb83b654a0 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.126754 Aug 10 13:32:04.204440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 432/874] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Aug 10 13:32:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:32:04.209116 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-160ed3ff-b303-474f-8b67-66fbfddde402 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Action: 'create', calling method: .version_select at 0x7ff6a37923a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-16910276", "metadata": {"Type": "work"}}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-160ed3ff-b303-474f-8b67-66fbfddde402 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Request method failure captured: Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 118 Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87NTLOt4m39P1b1Ar7j5448X5fYQBbbl1vwzWNjRmAaV4kYh1H4JwNvHDqhI_NIeotvA_ei2rF-AMA22lCxGIDpS-3GAMmE_ECT0EzpiL1WwGU5QBVBXrHKfveP46FwBu9G-H5kYgM57I-V3B9uR9aUMIYYOSuWxkPDqSugeASjwhK8 Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:32:04.213922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3d92122eca2433dab79cfa4d9601159", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 5739e405875f414abdc70552a3c073eb Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-16910276", "metadata": {"Type": "work"}}} Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: Aug 10 13:32:04.215568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-16910276', 'metadata': {'Type': 'work'}}}} Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi '0' Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:04.216426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:32:04.217837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:32:04.220210 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:32:04.220210 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.220210 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-160ed3ff-b303-474f-8b67-66fbfddde402 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:04.220210 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-160ed3ff-b303-474f-8b67-66fbfddde402 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010053 Aug 10 13:32:04.220210 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 443/875] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Aug 10 13:32:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:32:04.225296 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-41fd9b8e-ecee-439d-989b-4bfc72d17c8a tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Action: 'create', calling method: .version_select at 0x7ff6a36c4040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1042846292", "metadata": {"Type": "work"}}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-41fd9b8e-ecee-439d-989b-4bfc72d17c8a tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Request method failure captured: Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 119 Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87NTLOt4m39P1b1Ar7j5448X5fYQBbbl1vwzWNjRmAaV4kYh1H4JwNvHDqhI_NIeotvA_ei2rF-AMA22lCxGIDpS-3GAMmE_ECT0EzpiL1WwGU5QBVBXrHKfveP46FwBu9G-H5kYgM57I-V3B9uR9aUMIYYOSuWxkPDqSugeASjwhK8 Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:04.229858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3d92122eca2433dab79cfa4d9601159", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 5739e405875f414abdc70552a3c073eb Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1042846292", "metadata": {"Type": "work"}}} Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: Aug 10 13:32:04.231418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1042846292', 'metadata': {'Type': 'work'}}}} Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi '' Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:04.233196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:32:04.235820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:32:04.237142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:32:04.237142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.237142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-41fd9b8e-ecee-439d-989b-4bfc72d17c8a tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:04.237142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-41fd9b8e-ecee-439d-989b-4bfc72d17c8a tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009895 Aug 10 13:32:04.237142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 433/876] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Aug 10 13:32:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:32:04.241897 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-24d71343-273b-4cf3-877a-c54ca6f9fda7 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Calling method '.version_select at 0x7ff6a35d4940>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:04.286228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-24d71343-273b-4cf3-877a-c54ca6f9fda7 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] HTTP exception thrown: Volume tempest-invalid-1518230764 could not be found. Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-24d71343-273b-4cf3-877a-c54ca6f9fda7 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Request method failure captured: Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1518230764 HTTP/1.1 Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87NTLOt4m39P1b1Ar7j5448X5fYQBbbl1vwzWNjRmAaV4kYh1H4JwNvHDqhI_NIeotvA_ei2rF-AMA22lCxGIDpS-3GAMmE_ECT0EzpiL1WwGU5QBVBXrHKfveP46FwBu9G-H5kYgM57I-V3B9uR9aUMIYYOSuWxkPDqSugeASjwhK8 Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:32:04.288577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3d92122eca2433dab79cfa4d9601159", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 5739e405875f414abdc70552a3c073eb Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Volume tempest-invalid-1518230764 could not be found. Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'tempest-invalid-1518230764'} Aug 10 13:32:04.290212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1518230764 could not be found. (HTTP 404) (Request-ID: req-4b59927c-312b-43d9-9034-d3bf0066ff0b) Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.291155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:32:04.292555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1518230764 could not be found. Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:04.293891 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1518230764 could not be found. Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1518230764 could not be found. Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-24d71343-273b-4cf3-877a-c54ca6f9fda7 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Returning 404 to user: Volume tempest-invalid-1518230764 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-24d71343-273b-4cf3-877a-c54ca6f9fda7 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1518230764" status: 404 len: 99 microversion: 2.1 time: 0.053559 Aug 10 13:32:04.295351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 444/877] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 10 13:32:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1518230764 => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 13:32:04.304681 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f2de796a-857a-4699-9638-08f87a44ea44 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004643 Aug 10 13:32:04.305151 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 434/878] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Aug 10 13:32:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 10 13:32:04.317630 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-69ab939a-f9ae-4126-b250-ad9cdf0d4ebe tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007401 Aug 10 13:32:04.318325 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 445/879] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Aug 10 13:32:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 13:32:04.327465 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-98ec6667-a593-4567-892f-852e0b84d1b6 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Calling method '.version_select at 0x7ff6a372f0d0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:04.351547 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-b327d0de-06bc-49cb-a7bd-657f2387b4e0 req-ccc83bbf-4d31-4b2a-8793-0e145198302a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e911432d-1e92-4be9-aafd-3d73d7856531", "name": "network-vif-deleted", "tag": "3759549e-ec20-4693-b3c8-dd4e32d1cacb"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:04.365995 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b327d0de-06bc-49cb-a7bd-657f2387b4e0 req-ccc83bbf-4d31-4b2a-8793-0e145198302a service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:04.366669 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b327d0de-06bc-49cb-a7bd-657f2387b4e0 req-ccc83bbf-4d31-4b2a-8793-0e145198302a service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:04.367453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-b327d0de-06bc-49cb-a7bd-657f2387b4e0 req-ccc83bbf-4d31-4b2a-8793-0e145198302a service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:04.367648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-98ec6667-a593-4567-892f-852e0b84d1b6 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] HTTP exception thrown: Volume cabef80d-02fd-43c9-9488-37455c47fe6a could not be found. Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-98ec6667-a593-4567-892f-852e0b84d1b6 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Request method failure captured: Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: DELETE /compute/v2.1/os-volumes/cabef80d-02fd-43c9-9488-37455c47fe6a HTTP/1.1 Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87NTLOt4m39P1b1Ar7j5448X5fYQBbbl1vwzWNjRmAaV4kYh1H4JwNvHDqhI_NIeotvA_ei2rF-AMA22lCxGIDpS-3GAMmE_ECT0EzpiL1WwGU5QBVBXrHKfveP46FwBu9G-H5kYgM57I-V3B9uR9aUMIYYOSuWxkPDqSugeASjwhK8 Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:04.369625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3d92122eca2433dab79cfa4d9601159", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 5739e405875f414abdc70552a3c073eb Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Volume cabef80d-02fd-43c9-9488-37455c47fe6a could not be found. Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'cabef80d-02fd-43c9-9488-37455c47fe6a'} Aug 10 13:32:04.371147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cabef80d-02fd-43c9-9488-37455c47fe6a could not be found. (HTTP 404) (Request-ID: req-767b9d4c-3ad3-4d35-babf-f919177fd4bd) Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.371939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:32:04.373276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cabef80d-02fd-43c9-9488-37455c47fe6a could not be found. Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 13:32:04.375223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cabef80d-02fd-43c9-9488-37455c47fe6a could not be found. Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cabef80d-02fd-43c9-9488-37455c47fe6a could not be found. Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-98ec6667-a593-4567-892f-852e0b84d1b6 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Returning 404 to user: Volume cabef80d-02fd-43c9-9488-37455c47fe6a could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-98ec6667-a593-4567-892f-852e0b84d1b6 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/cabef80d-02fd-43c9-9488-37455c47fe6a" status: 404 len: 109 microversion: 2.1 time: 0.047574 Aug 10 13:32:04.376777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 435/880] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:32:04 2022] DELETE /compute/v2.1/os-volumes/cabef80d-02fd-43c9-9488-37455c47fe6a => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:04.383089 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1dca8c91-80c9-4942-8ee2-adb13774a1c8 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Calling method '.version_select at 0x7ff6a3703670>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:04.383398 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-b327d0de-06bc-49cb-a7bd-657f2387b4e0 req-ccc83bbf-4d31-4b2a-8793-0e145198302a service nova] Creating event network-vif-deleted:3759549e-ec20-4693-b3c8-dd4e32d1cacb for instance e911432d-1e92-4be9-aafd-3d73d7856531 on hv-cinder-83602 Aug 10 13:32:04.389445 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-b327d0de-06bc-49cb-a7bd-657f2387b4e0 req-ccc83bbf-4d31-4b2a-8793-0e145198302a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041070 Aug 10 13:32:04.389816 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 446/881] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:32:04.415646 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-1dca8c91-80c9-4942-8ee2-adb13774a1c8 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] HTTP exception thrown: Volume 08c51001-f854-4960-8a29-41425d129e2c could not be found. Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1dca8c91-80c9-4942-8ee2-adb13774a1c8 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Request method failure captured: Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/os-volumes/08c51001-f854-4960-8a29-41425d129e2c HTTP/1.1 Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87NTLOt4m39P1b1Ar7j5448X5fYQBbbl1vwzWNjRmAaV4kYh1H4JwNvHDqhI_NIeotvA_ei2rF-AMA22lCxGIDpS-3GAMmE_ECT0EzpiL1WwGU5QBVBXrHKfveP46FwBu9G-H5kYgM57I-V3B9uR9aUMIYYOSuWxkPDqSugeASjwhK8 Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:04.417654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3d92122eca2433dab79cfa4d9601159"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3d92122eca2433dab79cfa4d9601159", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: e3d92122eca2433dab79cfa4d9601159 Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-VolumesNegativeTest-1580212313 Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 5739e405875f414abdc70552a3c073eb Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-VolumesNegativeTest-1580212313-project Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Volume 08c51001-f854-4960-8a29-41425d129e2c could not be found. Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '08c51001-f854-4960-8a29-41425d129e2c'} Aug 10 13:32:04.419196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08c51001-f854-4960-8a29-41425d129e2c could not be found. (HTTP 404) (Request-ID: req-a5ba1f0b-4227-4115-808f-afc507a85d30) Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.420402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:32:04.423166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08c51001-f854-4960-8a29-41425d129e2c could not be found. Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:32:04.424520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08c51001-f854-4960-8a29-41425d129e2c could not be found. Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08c51001-f854-4960-8a29-41425d129e2c could not be found. Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1dca8c91-80c9-4942-8ee2-adb13774a1c8 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] Returning 404 to user: Volume 08c51001-f854-4960-8a29-41425d129e2c could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1dca8c91-80c9-4942-8ee2-adb13774a1c8 tempest-VolumesNegativeTest-1580212313 tempest-VolumesNegativeTest-1580212313-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/08c51001-f854-4960-8a29-41425d129e2c" status: 404 len: 109 microversion: 2.1 time: 0.040334 Aug 10 13:32:04.425932 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 436/882] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:04 2022] GET /compute/v2.1/os-volumes/08c51001-f854-4960-8a29-41425d129e2c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:32:04.685097 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:04.685995 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:04.692942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:04.693465 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:04.693903 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:04.694602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:04.695060 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:04.695487 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:04.726385 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:04.726865 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:04.727297 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:04.727745 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lazy-loading 'fault' on Instance uuid e911432d-1e92-4be9-aafd-3d73d7856531 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:32:04.771751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37b3d41c18541828b0aff71b4419bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72df548c9f74b06858740e09546179b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:04.779759 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3f09ce29-107e-425e-b682-895073deaf66 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 200 len: 1304 microversion: 2.1 time: 0.100055 Aug 10 13:32:04.780781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 447/883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:04 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:05.067319 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:05.067823 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:05.073960 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:05.074446 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:05.074886 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:05.075580 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:05.076042 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:05.076468 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:05.102195 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-84d5cc74-59a4-4808-9bd2-8220d5c3a953 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/ips" status: 200 len: 149 microversion: 2.1 time: 0.039399 Aug 10 13:32:05.102754 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 437/884] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:32:05 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:05.806156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:05.806766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] [instance: e911432d-1e92-4be9-aafd-3d73d7856531] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:05.813650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:05.814140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:05.814577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:05.815279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:05.815738 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:05.816167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:05.830437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] HTTP exception thrown: Instance e911432d-1e92-4be9-aafd-3d73d7856531 could not be found. Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Request method failure captured: Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 HTTP/1.1 Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87NAcMIiXhQfBNMkmznU8EiUwDyJvH0gTcuyYutmeaAFGFB9LikKpz_JJPoF7fYWDmFkz0MYdrRzQiNrc1SssIe7SnhmltEi5sdjC_pTPAjT5YMi-9DH8ArI8vXV4tfMYZqxP1hcZ_mM70UwimZDz4te0Bxnp1oZkFTmyTZ0O5ESgps Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: b72df548c9f74b06858740e09546179b Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-VolumesNegativeTest-361464378 Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:32:05.832085 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b72df548c9f74b06858740e09546179b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b72df548c9f74b06858740e09546179b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b72df548c9f74b06858740e09546179b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b72df548c9f74b06858740e09546179b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-VolumesNegativeTest-361464378 Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: b72df548c9f74b06858740e09546179b Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-VolumesNegativeTest-361464378 Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-VolumesNegativeTest-361464378-project Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: a37b3d41c18541828b0aff71b4419bb8 Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-VolumesNegativeTest-361464378-project Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance e911432d-1e92-4be9-aafd-3d73d7856531 could not be found. Aug 10 13:32:05.833698 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'e911432d-1e92-4be9-aafd-3d73d7856531'} Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e911432d-1e92-4be9-aafd-3d73d7856531 could not be found. Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:05.834831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e911432d-1e92-4be9-aafd-3d73d7856531 could not be found. Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e911432d-1e92-4be9-aafd-3d73d7856531 could not be found. Aug 10 13:32:05.836108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:05.838365 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] Returning 404 to user: Instance e911432d-1e92-4be9-aafd-3d73d7856531 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:05.839129 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e6b70785-2e9c-40bd-b2ba-ff46b6a69d00 tempest-VolumesNegativeTest-361464378 tempest-VolumesNegativeTest-361464378-project] 10.222.0.40 "GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531" status: 404 len: 111 microversion: 2.1 time: 0.036946 Aug 10 13:32:05.839674 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 448/885] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:05 2022] GET /compute/v2.1/servers/e911432d-1e92-4be9-aafd-3d73d7856531 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:06.752698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73e0d5ac-584f-40ba-b87b-c28e2d0385d3"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:06.756877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:06.761668 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:06.762516 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:06.763106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:06.763978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:06.764770 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:06.765467 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:07.595633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f19a5e46-c25b-469a-a124-d68b3272b69e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "POST /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846673 Aug 10 13:32:07.596240 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 438/886] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 10 13:32:06 2022] POST /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:08.396047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:08.396602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:08.402774 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:08.406918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:08.406918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:08.406918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:08.406918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:08.407281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:08.429752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-425e4a39-5f10-45fb-8178-de70dfbe6b4f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/ips" status: 200 len: 153 microversion: 2.20 time: 0.212439 Aug 10 13:32:08.430284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 449/887] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Aug 10 13:32:08 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/ips => generated 153 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:32:10.574084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:10.574625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:10.582406 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:10.582897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:10.583386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:10.584114 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:10.584621 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:10.585084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:10.608213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'flavor' on Instance uuid 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:32:11.101486 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6a1a0ee1-f028-4d4d-8fed-cbb5e7ed865e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/action" status: 202 len: 0 microversion: 2.20 time: 0.532257 Aug 10 13:32:11.102496 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 439/888] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Aug 10 13:32:10 2022] POST /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:32:11.110704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:11.111406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:11.118103 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:11.118792 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:11.119226 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:11.119975 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:11.120427 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:11.120848 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:11.255995 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:11.264107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:11.266306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:11.267469 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9d12a71f-23e4-4ea8-9206-14ad8097bac5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.161009 Aug 10 13:32:11.268040 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 450/889] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:11 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:12.292669 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:12.293415 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:12.300674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:12.301190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:12.301634 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:12.302326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:12.302775 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:12.303201 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:12.487402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:12.495510 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:12.497134 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:12.498293 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1d15a416-13b7-4a80-934c-638d29012b90 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.210506 Aug 10 13:32:12.498850 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 440/890] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:12 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:13.521879 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:13.522496 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:13.529079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:13.529569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:13.530010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:13.530710 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:13.531173 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:13.531602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:13.663164 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:13.671553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:13.673557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:13.674719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e7595e25-b2d7-4b2b-9138-8016073dbb44 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.156782 Aug 10 13:32:13.675272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 451/891] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:13 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:14.700737 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:14.701370 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:14.703988 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:14.708641 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:14.709223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:14.709663 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:14.710349 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:14.710800 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:14.711223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:14.844599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:14.852818 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:14.854359 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:14.855519 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-58cceb10-6eef-4ba4-b4be-920f9926b77f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.158729 Aug 10 13:32:14.856084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 441/892] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:14 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:15.880943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:15.882246 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:15.888294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:15.888776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:15.889233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:15.890621 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:15.891326 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:15.891761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:16.022387 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:16.032555 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:16.034585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:16.035835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-641ec41f-97b3-4331-b0cd-148ba1b9982c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.159102 Aug 10 13:32:16.036406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 452/893] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:15 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:16.354046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:16.354554 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:16.361668 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:16.362177 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:16.362616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:16.363303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:16.363756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:16.364179 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:16.445193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lazy-loading 'services' on Instance uuid a99c255d-d210-4be5-9251-441c5103a1ac {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:32:16.681196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7e187f56-7b2a-4b65-97db-1e93cca148b3 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-volume_attachments/73e0d5ac-584f-40ba-b87b-c28e2d0385d3" status: 202 len: 0 microversion: 2.1 time: 0.330880 Aug 10 13:32:16.684337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 442/894] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 10 13:32:16 2022] DELETE /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-volume_attachments/73e0d5ac-584f-40ba-b87b-c28e2d0385d3 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:32:16.690962 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:16.693599 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:16.699988 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:16.700478 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:16.700924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:16.701675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:16.702136 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:16.702568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:16.720695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:16.733706 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8312eb81-7df3-46ae-8e6b-fb7f2aab6415 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Aug 10 13:32:16.734774 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 453/895] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:32:16 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:17.059235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:17.059928 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:17.066733 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:17.067219 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:17.067658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:17.068348 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:17.068838 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:17.069296 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:17.206620 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:17.214719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:17.216315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:17.217493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fb90d709-736d-486b-b3c7-3000564c296a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.162604 Aug 10 13:32:17.218043 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 443/896] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:17 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:17.752809 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:17.755151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:17.762316 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:17.762800 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:17.763239 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:17.763929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:17.764383 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:17.764807 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:17.796425 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-70cb8863-f94c-4b10-a745-128582d52b95 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048562 Aug 10 13:32:17.796976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 454/897] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 10 13:32:17 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:32:17.859532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:17.860169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:17.867595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:17.868076 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:17.868505 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:17.869226 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:17.869675 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:17.870097 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:17.897267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:32:17.899197 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:18.179775 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2cd57dbc-4321-4945-814d-458a829df319 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 204 len: 0 microversion: 2.1 time: 0.323674 Aug 10 13:32:18.180273 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 444/898] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:32:17 2022] DELETE /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:32:18.188944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:18.189578 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:18.195595 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:18.196079 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:18.196545 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:18.197260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:18.197715 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:18.198140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:18.240337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:18.241064 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:18.247424 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:18.247652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:18.248143 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:18.248745 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:18.249244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:18.249672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:18.331832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:18.341116 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3f90b043-d91a-48c5-8641-f4316ce8197d tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1679 microversion: 2.1 time: 0.156367 Aug 10 13:32:18.342158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 455/899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:18 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:18.397722 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:18.406390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:18.408808 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:18.410508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-15d16085-aeec-4876-8ef8-4a5967446e81 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.174201 Aug 10 13:32:18.410985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 445/900] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:18 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:19.367527 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:19.368166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:19.370526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:19.375138 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:19.375613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:19.376090 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:19.376932 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:19.377413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:19.377835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:19.435109 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:19.435761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:19.444508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:19.445231 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:19.447290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:19.447290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:19.447290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:19.447290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:19.515696 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:19.523921 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-31cb2885-cdab-44ab-9d6b-c4588d88a478 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1679 microversion: 2.1 time: 0.160263 Aug 10 13:32:19.524495 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 456/901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:19 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:19.586770 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:19.595352 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:19.597041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:19.598253 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ee333460-2b1c-41db-90ff-f394a7478c9f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.167081 Aug 10 13:32:19.598812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 446/902] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:19 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:20.546423 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:20.547302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:20.554362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:20.558151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:20.558151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:20.558151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:20.558151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:20.558532 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:20.621613 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:20.622206 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:20.629720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:20.630203 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:20.630635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:20.631335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:20.631782 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:20.632201 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:20.778162 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:20.788327 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:20.790079 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:20.791423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a49dc708-d79d-4af7-bb25-78b002fa52ab tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.173640 Aug 10 13:32:20.792211 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 447/903] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:20 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:20.973953 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:20.981471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d5e6f845-cb59-489a-9ece-0c09b13cb29a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1679 microversion: 2.1 time: 0.439012 Aug 10 13:32:20.982041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 457/904] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:20 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1679 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:21.377865 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-e949cd69-761e-4cca-9890-ee876a2248b7 req-453a172c-c248-4aed-9f54-3c1f398d8ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99c255d-d210-4be5-9251-441c5103a1ac", "name": "network-vif-deleted", "tag": "39c4c2d7-4497-410a-8487-c926c213dd87"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:21.388275 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e949cd69-761e-4cca-9890-ee876a2248b7 req-453a172c-c248-4aed-9f54-3c1f398d8ce1 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:21.388893 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e949cd69-761e-4cca-9890-ee876a2248b7 req-453a172c-c248-4aed-9f54-3c1f398d8ce1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:21.389423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e949cd69-761e-4cca-9890-ee876a2248b7 req-453a172c-c248-4aed-9f54-3c1f398d8ce1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:21.400590 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-e949cd69-761e-4cca-9890-ee876a2248b7 req-453a172c-c248-4aed-9f54-3c1f398d8ce1 service nova] Creating event network-vif-deleted:39c4c2d7-4497-410a-8487-c926c213dd87 for instance a99c255d-d210-4be5-9251-441c5103a1ac on hv-cinder-83602 Aug 10 13:32:21.405601 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-e949cd69-761e-4cca-9890-ee876a2248b7 req-453a172c-c248-4aed-9f54-3c1f398d8ce1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031534 Aug 10 13:32:21.406491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 448/905] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:21.815040 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:21.816379 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:21.822979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:21.823535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:21.823985 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:21.824693 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:21.825189 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:21.825621 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:21.958486 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:21.966680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:21.968199 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:21.969395 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c69ec240-a11f-4ebc-aa30-c4358eca95ef tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.158328 Aug 10 13:32:21.969969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 458/906] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:21 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:22.005919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:22.006443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:22.013666 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:22.014152 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:22.014587 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:22.015286 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:22.015737 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:22.016301 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:22.053804 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:22.054409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:22.054916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:22.055439 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lazy-loading 'fault' on Instance uuid a99c255d-d210-4be5-9251-441c5103a1ac {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:32:22.100200 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9577bc4c4c546ca9fc220ebd3a16346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a97b47cc804e598c5e8680d279de19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:22.107793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ceb58dd6-1c38-4686-bd43-99d1b75e5e1a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 200 len: 1329 microversion: 2.1 time: 0.107581 Aug 10 13:32:22.108358 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 449/907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:21 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:22.994093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:22.994957 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:23.001422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:23.007472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:23.007472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:23.007472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:23.007472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:23.007876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:23.130074 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:23.130790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:23.137321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:23.140823 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:23.141874 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:23.142338 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:23.143315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:23.143940 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:23.144534 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:23.154436 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:23.156650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:23.175328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e9de6bb1-89f8-44ff-831d-e4d87aec214e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.169084 Aug 10 13:32:23.175328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 459/908] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:22 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac HTTP/1.1 Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:23.175523 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:23.177954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'a99c255d-d210-4be5-9251-441c5103a1ac'} Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:23.178815 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:23.180306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:23.181685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:23.181685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a8f4df4c-5c63-445f-9640-002b6b497ec5 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 404 len: 111 microversion: 2.1 time: 0.039078 Aug 10 13:32:23.181685 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 450/909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:23 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:32:23.181955 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-93d7f982-4b7c-4968-827f-ef688392456e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '.version_select at 0x7ff6a80991f0>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:23.306194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-93d7f982-4b7c-4968-827f-ef688392456e tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-577956715" status: 202 len: 0 microversion: 2.1 time: 0.130225 Aug 10 13:32:23.306790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 460/910] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 10 13:32:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-577956715 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:32:24.187157 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:24.188275 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:24.196567 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:24.197433 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:24.197567 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:24.198177 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:24.198634 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:24.199059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:24.362017 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:24.376577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:24.376577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:24.376577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9d8f9a70-8854-49d7-8d7f-cd5cb499e318 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.193748 Aug 10 13:32:24.376869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 451/911] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:24 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:25.408159 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:25.409373 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:25.410012 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:25.410233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:25.415937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:25.416418 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:25.416734 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:25.416845 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:25.417385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:25.417565 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:25.417947 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:25.418067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:25.418434 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:25.418905 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:25.419430 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:25.419853 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:25.434607 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: DELETE /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac HTTP/1.1 Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:25.436337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.437845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'a99c255d-d210-4be5-9251-441c5103a1ac'} Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:25.438678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.440003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.441390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:25.441390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f39cdeb1-647c-4b45-8170-1dbb73b3a4e1 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 404 len: 111 microversion: 2.1 time: 0.033859 Aug 10 13:32:25.441390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 452/912] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:32:25 2022] DELETE /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:25.447208 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:25.447971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: a99c255d-d210-4be5-9251-441c5103a1ac] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:25.454032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:25.454513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:25.454938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:25.455624 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:25.456069 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:25.456486 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:25.470693 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac HTTP/1.1 Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:25.472236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.474183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'a99c255d-d210-4be5-9251-441c5103a1ac'} Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:25.475013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. Aug 10 13:32:25.476222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:25.477396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance a99c255d-d210-4be5-9251-441c5103a1ac could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:25.477396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-daee1759-189a-48af-a4fd-c8d2c207f717 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac" status: 404 len: 111 microversion: 2.1 time: 0.031077 Aug 10 13:32:25.477396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 453/913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:25 2022] GET /compute/v2.1/servers/a99c255d-d210-4be5-9251-441c5103a1ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:25.557583 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:25.565550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:25.567718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:25.568884 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-592eb3bf-32d1-40a9-a6c4-af851458f627 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.165061 Aug 10 13:32:25.569482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 461/914] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:25 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:26.592863 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:26.593683 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:26.600619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.601338 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.601752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.602451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.602912 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.603372 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.737694 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:26.745809 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:26.747276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:26.748452 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5d7721a2-0bba-4670-b6da-3ea4df9376a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.159496 Aug 10 13:32:26.749041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 454/915] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:26 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:26.791397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:26.794711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:26.798653 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.799128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.799652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.800345 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.800847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.801425 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.817610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: DELETE /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe HTTP/1.1 Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:32:26.820847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.822396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '5c655ab7-4709-47e3-88ea-1841fa80d3fe'} Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:26.823238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.824523 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.825931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:26.825931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8cd65116-6fd9-42ab-bdd2-27a3f2e0c511 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 404 len: 111 microversion: 2.1 time: 0.035206 Aug 10 13:32:26.825931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 462/916] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:32:26 2022] DELETE /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:26.830832 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:26.831485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 5c655ab7-4709-47e3-88ea-1841fa80d3fe] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:26.838066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.838546 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.838980 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.839674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.840129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.840553 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.853835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe HTTP/1.1 Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:26.855315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.856873 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '5c655ab7-4709-47e3-88ea-1841fa80d3fe'} Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:26.857916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. Aug 10 13:32:26.859380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.861087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 5c655ab7-4709-47e3-88ea-1841fa80d3fe could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:26.861087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fdd8ec32-7148-4168-a494-7fae99870bc7 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe" status: 404 len: 111 microversion: 2.1 time: 0.029783 Aug 10 13:32:26.861087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 455/917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:26 2022] GET /compute/v2.1/servers/5c655ab7-4709-47e3-88ea-1841fa80d3fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:26.865585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:26.866093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:26.872024 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.872536 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.872976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.873713 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.874172 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.874601 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.888681 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: DELETE /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b HTTP/1.1 Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:32:26.890321 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.891900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b'} Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:26.892804 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.894280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.895805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:26.895805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-bf843796-2d5f-49d3-9c1e-822f79454da2 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 404 len: 111 microversion: 2.1 time: 0.030490 Aug 10 13:32:26.895805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 463/918] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:32:26 2022] DELETE /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:26.900664 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:26.901369 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:26.907227 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.907707 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.908136 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.908811 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:26.909540 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:26.909958 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:26.923060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b HTTP/1.1 Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:26.924537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.926155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b'} Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:26.926999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. Aug 10 13:32:26.928923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:26.930397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:26.930397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4e10830e-dce5-457d-bc7f-778cbbbc707a tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b" status: 404 len: 111 microversion: 2.1 time: 0.029728 Aug 10 13:32:26.930397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 456/919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:26 2022] GET /compute/v2.1/servers/2dd44f69-12ae-4b2a-b8ae-cd5732c90f8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:27.772125 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:27.772733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:27.778678 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:27.779165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:27.779604 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:27.780297 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:27.780757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:27.781221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:27.914841 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:27.923153 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:27.924674 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:27.925929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-684c756f-f712-4f4d-bd5e-49b16c622dc6 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1744 microversion: 2.20 time: 0.157806 Aug 10 13:32:27.926484 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 464/920] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:27 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:28.161999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:28.162549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:28.168888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:28.169407 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:28.169845 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:28.170542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:28.170995 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:28.171416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:28.184721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: DELETE /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 HTTP/1.1 Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:32:28.186268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.187639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '632d02cd-2985-4976-944b-0a5c9acf06c6'} Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:28.188373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.189628 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.190891 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:28.190891 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f67761f3-41b4-418f-b51e-e759a81c5710 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "DELETE /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 404 len: 111 microversion: 2.1 time: 0.029758 Aug 10 13:32:28.190891 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 457/921] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:32:28 2022] DELETE /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:28.200025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:28.200766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] [instance: 632d02cd-2985-4976-944b-0a5c9acf06c6] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:28.206814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:28.207309 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:28.207753 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:28.209162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:28.209631 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:28.210069 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:28.223428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] HTTP exception thrown: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Request method failure captured: Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 HTTP/1.1 Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87HK3b7DxlAACN-y0Jk6LUalXvMVqQpvDvSp2oCeVL_ek8uWEoD7blCZzdKVv3sxesC91EpklbRY0qw5JTU-CWNmPIMX-_DlWhfjOd1VcGex0uXVlj_ve5SA8jcUD2VC9ulz2s5X2iPiD_MVzEdt3rbuZxRNsk2ByDOipSf58VKxO2A Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:32:28.225535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26a97b47cc804e598c5e8680d279de19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26a97b47cc804e598c5e8680d279de19", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 26a97b47cc804e598c5e8680d279de19 Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1667397108 Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: c9577bc4c4c546ca9fc220ebd3a16346 Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeNegativeTest-1667397108-project Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.228300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '632d02cd-2985-4976-944b-0a5c9acf06c6'} Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:28.229918 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. Aug 10 13:32:28.232021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:28.233928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] Returning 404 to user: Instance 632d02cd-2985-4976-944b-0a5c9acf06c6 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:28.233928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a608817d-948b-47b3-91aa-eb62ebb3bc67 tempest-AttachVolumeNegativeTest-1667397108 tempest-AttachVolumeNegativeTest-1667397108-project] 10.222.0.40 "GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6" status: 404 len: 111 microversion: 2.1 time: 0.030850 Aug 10 13:32:28.233928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 465/922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:32:28 2022] GET /compute/v2.1/servers/632d02cd-2985-4976-944b-0a5c9acf06c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:28.951574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:28.952289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:28.958257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:28.958771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:28.959319 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:28.959995 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:28.960462 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:28.960874 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:29.174610 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:29.186399 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:29.187941 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:29.189141 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-158519e8-7350-42a0-890b-ae1651ece22c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.243373 Aug 10 13:32:29.189698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 458/923] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:28 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:30.214527 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:30.216487 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:30.230969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:30.235876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:30.237407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:30.241089 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:30.241779 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:30.242384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:30.357985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-28e85053-55fd-4a70-93b3-0d8b66c99852 req-4133a304-f099-4e00-851e-3c6c792c2424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb", "name": "network-vif-plugged", "status": "completed", "tag": "fb29def7-e001-4e1b-a67d-f091c1548451"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:30.384622 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-28e85053-55fd-4a70-93b3-0d8b66c99852 req-4133a304-f099-4e00-851e-3c6c792c2424 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:30.385129 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-28e85053-55fd-4a70-93b3-0d8b66c99852 req-4133a304-f099-4e00-851e-3c6c792c2424 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:30.387669 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-28e85053-55fd-4a70-93b3-0d8b66c99852 req-4133a304-f099-4e00-851e-3c6c792c2424 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:30.404290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-28e85053-55fd-4a70-93b3-0d8b66c99852 req-4133a304-f099-4e00-851e-3c6c792c2424 service nova] Creating event network-vif-plugged:fb29def7-e001-4e1b-a67d-f091c1548451 for instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb on hv-cinder-83602 Aug 10 13:32:30.426838 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-28e85053-55fd-4a70-93b3-0d8b66c99852 req-4133a304-f099-4e00-851e-3c6c792c2424 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074497 Aug 10 13:32:30.432676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 459/924] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:32:30.584928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:30.607777 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:30.609251 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:30.610440 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e208525c-adb3-42f0-b10d-81b6857b887f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.400558 Aug 10 13:32:30.621067 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 466/925] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:30 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:31.638183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:31.638989 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:31.657732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:31.658378 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:31.659173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:31.660090 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:31.660654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:31.661385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:31.850340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:31.858007 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:31.860630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:31.862111 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dd43062e-5dd6-46ac-88ea-0477c42a79ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.230125 Aug 10 13:32:31.876302 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 460/926] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:31 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:32.894407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:32.894870 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:32.903572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:32.904367 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:32.904986 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:32.906211 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:32.906847 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:32.907432 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:33.075373 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:33.084552 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:33.086755 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:33.087953 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e09149e2-2217-418a-9d25-7b4a414f1609 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.201214 Aug 10 13:32:33.088539 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 467/927] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:32 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:34.116751 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:34.117556 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:34.124653 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:34.132020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:34.132020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:34.132020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:34.132020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:34.132374 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:34.329542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:34.343564 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:34.345167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:34.346380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ad46c940-307e-40bf-90bf-e7ff7b3cf2b4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.234649 Aug 10 13:32:34.353038 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 461/928] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:34 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:35.372119 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:35.372781 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:35.380498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:35.381323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:35.381968 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:35.383007 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:35.384513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:35.385899 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:35.389740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-72864bd7-438a-4587-80bb-18424269be7b tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Action: 'create', calling method: .version_select at 0x7ff6a805e3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1892864730", "metadata": {"Type": "work"}}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:35.565056 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:35.577796 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:35.582494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:35.584524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-81818bee-688b-4109-8f39-71d046f80b7b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.216791 Aug 10 13:32:35.586027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 462/929] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:35 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:36.146943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-72864bd7-438a-4587-80bb-18424269be7b tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.889684 Aug 10 13:32:36.147594 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 468/930] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Aug 10 13:32:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 891 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 13:32:36.160816 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-7528e265-c644-4bbe-9b48-8d014cfe55ed tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Calling method '.version_select at 0x7ff6a3703670>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:36.219736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-7528e265-c644-4bbe-9b48-8d014cfe55ed tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9" status: 200 len: 353 microversion: 2.1 time: 0.063333 Aug 10 13:32:36.226803 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 463/931] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:36 2022] GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:36.610335 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:36.610935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:36.621912 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:36.631073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:36.631073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:36.631073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:36.631073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:36.631473 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:36.756976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:36.766119 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:36.768962 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:36.770370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0df90926-12e5-43f9-84e5-cb673ee690fb tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.164476 Aug 10 13:32:36.772059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 469/932] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:36 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:37.235302 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0740418e-fc10-404f-836f-3b36fbd29396 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Calling method '.version_select at 0x7ff6a36dd0d0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:37.293375 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0740418e-fc10-404f-836f-3b36fbd29396 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9" status: 200 len: 354 microversion: 2.1 time: 0.062589 Aug 10 13:32:37.294524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 464/933] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:37 2022] GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:37.307743 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5da0e005-60b0-4780-9f4e-79a0b3f04df3 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Calling method '.version_select at 0x7ff6a3717ee0>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:37.367838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5da0e005-60b0-4780-9f4e-79a0b3f04df3 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9" status: 200 len: 354 microversion: 2.1 time: 0.064232 Aug 10 13:32:37.368563 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 470/934] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:37 2022] GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:37.383298 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e0e32e82-fdd4-47db-ba23-593194ac5e82 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Calling method '.version_select at 0x7ff6a36dd790>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:37.557100 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e0e32e82-fdd4-47db-ba23-593194ac5e82 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9" status: 202 len: 0 microversion: 2.1 time: 0.178048 Aug 10 13:32:37.561104 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 465/935] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 10 13:32:37 2022] DELETE /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:32:37.566474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-617d41a1-46dd-4dfa-8b10-258f0e02cdad tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Calling method '.version_select at 0x7ff6a3706280>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:37.619763 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-617d41a1-46dd-4dfa-8b10-258f0e02cdad tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9" status: 200 len: 353 microversion: 2.1 time: 0.057738 Aug 10 13:32:37.620327 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 471/936] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:37 2022] GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:32:37.797594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:37.798336 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:37.804967 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:37.805876 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:37.806323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:37.807267 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:37.807741 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:37.808173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:37.966056 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:37.977626 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:37.980322 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:37.982063 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-45967e2e-a7e9-4b85-bbc3-3aabd1ae9a07 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.188283 Aug 10 13:32:37.998761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 466/937] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:37 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:38.634940 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1cce9183-8882-4ab6-9324-bf160343ebcd tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Calling method '.version_select at 0x7ff6a80e0430>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:38.702477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1cce9183-8882-4ab6-9324-bf160343ebcd tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9" status: 200 len: 353 microversion: 2.1 time: 0.066928 Aug 10 13:32:38.702477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 472/938] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:38 2022] GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:39.007302 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:39.007856 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:39.017977 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:39.018457 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:39.018903 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:39.019603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:39.020059 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:39.021030 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:39.178951 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:39.183103 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:39.188560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:39.190197 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:39.191432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-fab16e71-5899-49fb-8b77-c9c08c1a9efa tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.190327 Aug 10 13:32:39.192009 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 467/939] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:38 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:39.712059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-61cb24e4-9ace-49e5-b72a-6c46413609ff tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Calling method '.version_select at 0x7ff6a8099e50>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:39.779026 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-61cb24e4-9ace-49e5-b72a-6c46413609ff tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9" status: 200 len: 353 microversion: 2.1 time: 0.071038 Aug 10 13:32:39.779606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 473/940] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:39 2022] GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:40.216416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:40.217761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:40.225982 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:40.226460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:40.226894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:40.227616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:40.228060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:40.228474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:40.363189 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:40.372375 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:40.373987 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:40.375205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a0b59e61-a564-4848-95e1-2d4cf82b6f75 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1739 microversion: 2.20 time: 0.163884 Aug 10 13:32:40.375765 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 468/941] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:40 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:40.794100 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-af399bb8-60b4-4656-898f-6ed047c015b1 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Calling method '.version_select at 0x7ff6a81001f0>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:40.827792 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-af399bb8-60b4-4656-898f-6ed047c015b1 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] HTTP exception thrown: Volume c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 could not be found. Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-af399bb8-60b4-4656-898f-6ed047c015b1 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Request method failure captured: Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 HTTP/1.1 Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87Nzk_zltMY7rk28_CRGPs12-k4U13-E7DN2e7TvnL1vL0qnP6FuYHsBsPOZuTtlY1CGahDA5E_Vuxlp_zVC9buXFLvMLr0Ol7dag4KtPsLt-usj6ybhe-GiQI3wqMXjM3Utv6yIoQZlnRYr84v4F5khug02ivOZst70aQpURWFe5q0 Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: 2b00137741fe4d079bf33bc0e4add53b Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-VolumesGetTestJSON-143711231 Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:32:40.832598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2b00137741fe4d079bf33bc0e4add53b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2b00137741fe4d079bf33bc0e4add53b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2b00137741fe4d079bf33bc0e4add53b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2b00137741fe4d079bf33bc0e4add53b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-VolumesGetTestJSON-143711231 Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: 2b00137741fe4d079bf33bc0e4add53b Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-VolumesGetTestJSON-143711231 Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-VolumesGetTestJSON-143711231-project Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 7080cd300ff8442d9eab1ec7a09ae257 Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-VolumesGetTestJSON-143711231-project Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Volume c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 could not be found. Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'c8c55da8-74b4-4fcd-b70a-fff43e1a85c9'} Aug 10 13:32:40.834791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 could not be found. (HTTP 404) (Request-ID: req-80b8002f-a5e3-43d0-ad57-096c882e0335) Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:40.835667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:32:40.836959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 could not be found. Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:32:40.838260 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 could not be found. Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 could not be found. Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-af399bb8-60b4-4656-898f-6ed047c015b1 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] Returning 404 to user: Volume c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-af399bb8-60b4-4656-898f-6ed047c015b1 tempest-VolumesGetTestJSON-143711231 tempest-VolumesGetTestJSON-143711231-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9" status: 404 len: 109 microversion: 2.1 time: 0.045621 Aug 10 13:32:40.839667 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 474/942] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:40 2022] GET /compute/v2.1/os-volumes/c8c55da8-74b4-4fcd-b70a-fff43e1a85c9 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:32:41.399013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:41.399789 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:41.406556 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:41.407043 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:41.407483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:41.408183 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:41.408793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:41.409667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:41.565583 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:41.575842 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:41.577387 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:41.578573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-de3e7bad-07c9-4758-a385-75d20cff4437 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1721 microversion: 2.20 time: 0.183690 Aug 10 13:32:41.579117 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 469/943] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:41 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:42.611557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:42.612162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:42.619117 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:42.619596 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:42.620140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:42.620874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:42.621372 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:42.621805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:42.779559 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:42.788870 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:42.790567 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:42.791728 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-188aed7d-5e6a-4233-9c97-0c28a37459c7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1721 microversion: 2.20 time: 0.184573 Aug 10 13:32:42.792283 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 475/944] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:42 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:43.817551 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:43.818684 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:43.825592 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:43.826084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:43.826528 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:43.827229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:43.827707 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:43.828139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:43.966620 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:43.975138 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:43.976854 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:43.978057 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ce3be8b4-91f5-41fa-9d1b-aa0e58543232 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1721 microversion: 2.20 time: 0.164513 Aug 10 13:32:43.984937 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 470/945] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:43 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:44.264477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-68418fb8-539c-45ab-8693-adb6a9436948 req-2f2814df-005e-492b-8c68-9d5209736c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb", "name": "network-vif-unplugged", "status": "completed", "tag": "fb29def7-e001-4e1b-a67d-f091c1548451"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:44.275778 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-68418fb8-539c-45ab-8693-adb6a9436948 req-2f2814df-005e-492b-8c68-9d5209736c47 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:44.276144 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-68418fb8-539c-45ab-8693-adb6a9436948 req-2f2814df-005e-492b-8c68-9d5209736c47 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:44.276726 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-68418fb8-539c-45ab-8693-adb6a9436948 req-2f2814df-005e-492b-8c68-9d5209736c47 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:44.288720 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-68418fb8-539c-45ab-8693-adb6a9436948 req-2f2814df-005e-492b-8c68-9d5209736c47 service nova] Creating event network-vif-unplugged:fb29def7-e001-4e1b-a67d-f091c1548451 for instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb on hv-cinder-83602 Aug 10 13:32:44.294346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-68418fb8-539c-45ab-8693-adb6a9436948 req-2f2814df-005e-492b-8c68-9d5209736c47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033639 Aug 10 13:32:44.302113 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 476/946] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:44.758440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cb170a71-eb24-4e3a-aa18-696093f6e961 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a372f700>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:44.805242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cb170a71-eb24-4e3a-aa18-696093f6e961 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1049898b-2158-4d8b-bb3f-c79cca05cae5" status: 200 len: 351 microversion: 2.1 time: 0.050905 Aug 10 13:32:44.805830 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 471/947] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:44 2022] GET /compute/v2.1/os-volumes/1049898b-2158-4d8b-bb3f-c79cca05cae5 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:45.002733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:45.004955 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:45.010252 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:45.010741 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:45.011219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:45.011904 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:45.012359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:45.012785 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:45.143682 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:45.152219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:45.153842 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:45.154998 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c80010f7-2f0c-4db4-9577-98546ed8a57c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1664 microversion: 2.20 time: 0.156846 Aug 10 13:32:45.155551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 477/948] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:44 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:45.178769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9b06aa7-54fa-4aee-8ea8-fdc2f62e76f3"}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:45.181132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:45.187635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:45.188125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:45.188559 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:45.189276 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:45.189731 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:45.190158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:46.268839 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5894ade7-14d6-4e6a-8684-6061c6745bc3 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.094748 Aug 10 13:32:46.269640 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 472/949] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Aug 10 13:32:45 2022] POST /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/os-volume_attachments => generated 188 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:32:46.398651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:46.399159 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:46.405584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:46.406075 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:46.406514 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:46.407208 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:46.407668 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:46.408098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:46.409456 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-062c1ccc-a320-4ae8-8cfc-00cf6a456e10 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a3703940>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:46.461489 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-062c1ccc-a320-4ae8-8cfc-00cf6a456e10 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/7878e00f-4b14-4b08-838a-f333dd6e5ce8" status: 200 len: 350 microversion: 2.1 time: 0.056070 Aug 10 13:32:46.462060 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 473/950] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:46 2022] GET /compute/v2.1/os-volumes/7878e00f-4b14-4b08-838a-f333dd6e5ce8 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:46.580537 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:47.024285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d8b03039-212e-490a-baa7-166663c7e929 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/os-volume_attachments/b9b06aa7-54fa-4aee-8ea8-fdc2f62e76f3" status: 202 len: 0 microversion: 2.20 time: 0.630436 Aug 10 13:32:47.025556 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 478/951] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Aug 10 13:32:46 2022] DELETE /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/os-volume_attachments/b9b06aa7-54fa-4aee-8ea8-fdc2f62e76f3 => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:32:47.092747 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:32:47.093566 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:47.097744 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:47.102519 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:47.103163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:47.103416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:47.104472 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:47.104877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:47.105337 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:47.151170 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118002) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 13:32:47.489173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dda948dd-0419-4a0e-b849-d296dbf032e8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "POST /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/action" status: 202 len: 0 microversion: 2.20 time: 0.400845 Aug 10 13:32:47.491503 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 474/952] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Aug 10 13:32:47 2022] POST /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:32:47.498518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:47.499137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:47.506137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:47.506775 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:47.507232 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:47.507937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:47.508399 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:47.508833 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:47.654725 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:47.664681 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:47.666524 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:47.667876 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-787a05aa-1628-4ed5-8197-b9417e5f4a43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1672 microversion: 2.20 time: 0.173233 Aug 10 13:32:47.669108 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 479/953] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:47 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:48.080410 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dfe3248e-c17d-4d51-9279-752f89236a59 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a3703ca0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.135543 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dfe3248e-c17d-4d51-9279-752f89236a59 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9d81af74-8ef2-4923-9f90-5d995966f4ae" status: 200 len: 351 microversion: 2.1 time: 0.059115 Aug 10 13:32:48.136118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 475/954] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes/9d81af74-8ef2-4923-9f90-5d995966f4ae => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:48.150480 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1156e477-511a-4763-9f66-97db8b12606f tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a80e04c0>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.244333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1156e477-511a-4763-9f66-97db8b12606f tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.098603 Aug 10 13:32:48.245351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 480/955] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:48.260374 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0cb2d351-8165-487d-a512-852ccd671405 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a36dd5e0>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.346316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0cb2d351-8165-487d-a512-852ccd671405 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090843 Aug 10 13:32:48.349142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 476/956] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:48.360592 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ed6766f7-0169-4609-b76b-0b975a586940 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a3629dc0>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.446550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ed6766f7-0169-4609-b76b-0b975a586940 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089879 Aug 10 13:32:48.447158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 481/957] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:48.460025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1787c715-6272-4b17-9796-03e9c1d1f86b tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a372fb80>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.543900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1787c715-6272-4b17-9796-03e9c1d1f86b tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088215 Aug 10 13:32:48.547642 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 477/958] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:48.559498 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-4e38b3e8-5d52-4dc9-a07c-b18b9a26a1e0 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a820e790>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.643055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-4e38b3e8-5d52-4dc9-a07c-b18b9a26a1e0 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088642 Aug 10 13:32:48.643797 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 482/959] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:32:48.660164 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-dd9466e3-e7fe-4d79-93f1-dfabe644cfd5 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a3703c10>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.690423 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.691025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:48.697502 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:48.698064 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:48.701013 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:48.701013 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:48.701013 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:48.701013 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:48.748875 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-dd9466e3-e7fe-4d79-93f1-dfabe644cfd5 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094548 Aug 10 13:32:48.752380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 478/960] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:48.762381 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-22c0fb2c-0c59-4cd9-ad5a-79227c727a1e tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a36d0790>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.851461 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-22c0fb2c-0c59-4cd9-ad5a-79227c727a1e tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092819 Aug 10 13:32:48.856084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 479/961] 10.222.0.40 () {58 vars in 1188 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:32:48.864320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:48.866496 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f99fbcc7-a1ca-4d01-b338-1c25d48a6a33 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] Calling method '.version_select at 0x7ff6a375a790>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:48.875289 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:48.877529 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:48.879090 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-05a8b855-ff7e-4c2e-a0a4-40998665603e tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1672 microversion: 2.20 time: 0.192537 Aug 10 13:32:48.880069 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 483/962] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:48.960985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f99fbcc7-a1ca-4d01-b338-1c25d48a6a33 tempest-VolumesTestJSON-635721641 tempest-VolumesTestJSON-635721641-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099553 Aug 10 13:32:48.961579 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 480/963] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Aug 10 13:32:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:32:49.910154 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:49.910762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:49.913577 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:49.918188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:49.918676 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:49.919134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:49.919827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:49.920282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:49.920708 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:50.055259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:50.063200 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:50.064747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:50.065941 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3ea043c3-d52b-4407-894b-e37b07da41fd tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.160000 Aug 10 13:32:50.066509 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 484/964] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:49 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:51.092223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:51.092790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:51.098753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:51.099888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:51.100317 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:51.101009 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:51.101461 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:51.101879 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:51.231668 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:51.239571 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:51.241121 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:51.242268 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5f76c421-ae59-4f1e-a8a8-5cda189c2274 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.154569 Aug 10 13:32:51.242820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 481/965] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:51 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:52.265489 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:52.266105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:52.273421 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:52.273902 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:52.274339 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:52.275027 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:52.275483 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:52.275909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:52.406370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:52.415098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:52.416666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:52.417855 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-31a60544-c95d-4975-b2e0-742aa44c45ba tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.156255 Aug 10 13:32:52.418406 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 485/966] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:52 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:53.441360 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:53.442003 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:53.449313 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:53.449805 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:53.450245 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:53.450939 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:53.451400 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:53.451829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:53.590645 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:53.605683 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:53.605683 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:53.606603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-25582896-2b02-4ad4-9ce3-60a037f68fd8 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.169081 Aug 10 13:32:53.621675 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 482/967] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:53 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:54.631076 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:54.631895 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:54.639016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:54.639815 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:54.640550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:54.641517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:54.642852 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:54.643481 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:54.814412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:54.823690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:54.825325 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:54.827328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-0ef895d2-a1ce-40ba-a9ae-6b01ba9854ce tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.199422 Aug 10 13:32:54.827328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 486/968] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:54 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:55.852193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:55.852897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:55.864235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:55.866494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:55.868182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:55.873866 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:55.874537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:55.875155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:56.097626 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:56.108243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:56.110339 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:56.114340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5546527f-bf7c-47be-a76b-52fe53644d0f tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.268139 Aug 10 13:32:56.123221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 483/969] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:55 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:57.138671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:57.139284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:57.146384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:57.146870 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:57.147304 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:57.148665 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:57.149243 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:57.149594 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:57.304460 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:57.313101 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:57.315306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:57.316073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1b31339f-3106-48e1-838b-57434d1ee2dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.181383 Aug 10 13:32:57.329282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 487/970] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:57 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:58.344209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:58.345583 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:58.354235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:58.357657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:58.358283 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:58.360789 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:58.361467 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:58.363357 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:58.542710 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:58.555313 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:58.564458 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:58.571481 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ac9ac428-d7b4-4fbc-b49a-5fb7fcc768dc tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.228586 Aug 10 13:32:58.572344 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 484/971] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:58 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:59.596095 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:59.596829 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:32:59.604801 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:59.605396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:59.606139 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:59.606925 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:32:59.607587 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:32:59.608013 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:32:59.757585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:59.767565 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:59.769569 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:32:59.770976 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1796b758-f0d6-44d6-8f7a-4734577667b5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.178989 Aug 10 13:32:59.772231 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 488/972] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:32:59 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:00.797333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:00.798175 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:00.810092 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:00.814184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:00.814184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:00.814184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:00.814184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:00.814611 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:00.972165 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:00.982516 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:00.984045 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:00.985383 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-35d92b4d-6c99-4b7f-8768-70cea9ff9174 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.191685 Aug 10 13:33:00.985941 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 485/973] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:00 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:02.012457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:02.040265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:02.040265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:02.040265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:02.040265 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:02.040729 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:02.040729 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:02.040729 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:02.499790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:02.508543 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:02.510071 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:02.511234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f5cd9e16-4736-4c7e-8c4b-d2280674bfc9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.504107 Aug 10 13:33:02.511792 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 489/974] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:02 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:33:03.534315 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:03.535046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:03.543171 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:03.543918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:03.544616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:03.545493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:03.546099 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:03.546587 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:03.758713 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:03.768897 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:03.775942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:03.775942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-571c046c-db93-44c9-a7e2-6c4e7608f9b7 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.243912 Aug 10 13:33:03.775942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 486/975] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:03 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:04.798082 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:04.798696 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:04.805721 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:04.806573 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:04.807009 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:04.807704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:04.808154 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:04.808570 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:04.973181 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:04.982496 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:04.984272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:04.986105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-dd2d1760-34a3-4378-aade-56c05463d1f9 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.191962 Aug 10 13:33:04.987240 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 490/976] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:04 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:06.024466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:06.025657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:06.032691 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:06.033324 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:06.034110 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:06.034925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:06.035451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:06.035987 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:06.179967 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:06.188001 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:06.189441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:06.190588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8cc88afc-bb23-4967-81b5-f8f687ed10a1 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.170680 Aug 10 13:33:06.191142 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 487/977] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:06 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:06.447166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-20e33a86-fade-4b6e-b151-9734f9d477d0 req-6b0105fd-b00b-4cab-8d64-637e1ef2fa57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb", "name": "network-vif-plugged", "status": "completed", "tag": "fb29def7-e001-4e1b-a67d-f091c1548451"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:33:06.457668 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-20e33a86-fade-4b6e-b151-9734f9d477d0 req-6b0105fd-b00b-4cab-8d64-637e1ef2fa57 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:06.458362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-20e33a86-fade-4b6e-b151-9734f9d477d0 req-6b0105fd-b00b-4cab-8d64-637e1ef2fa57 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:06.459093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-20e33a86-fade-4b6e-b151-9734f9d477d0 req-6b0105fd-b00b-4cab-8d64-637e1ef2fa57 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:06.480006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-20e33a86-fade-4b6e-b151-9734f9d477d0 req-6b0105fd-b00b-4cab-8d64-637e1ef2fa57 service nova] Creating event network-vif-plugged:fb29def7-e001-4e1b-a67d-f091c1548451 for instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb on hv-cinder-83602 Aug 10 13:33:06.486001 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-20e33a86-fade-4b6e-b151-9734f9d477d0 req-6b0105fd-b00b-4cab-8d64-637e1ef2fa57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044394 Aug 10 13:33:06.486525 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 491/978] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:33:07.214062 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:07.214665 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:07.221661 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:07.222180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:07.222612 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:07.223710 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:07.224187 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:07.224610 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:07.372900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:07.376389 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:33:07.382361 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:07.383877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:07.385070 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-781d71fc-bb6c-4001-b514-b04a3565dc52 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.174796 Aug 10 13:33:07.385625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 488/979] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:07 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:08.415003 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:08.415711 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:08.422773 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:08.423663 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:08.424109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:08.424822 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:08.425311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:08.425740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:08.577412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:08.586402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:08.588114 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:08.589531 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a148ed9f-1596-4de6-bac5-037aa20bf8da tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.179656 Aug 10 13:33:08.604760 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 492/980] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:08 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:09.612366 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:09.612976 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:09.621692 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:09.622426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:09.622861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:09.623568 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:09.623992 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:09.624490 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:09.766877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:09.775369 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:09.777144 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:09.793204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-07e04fe8-6f06-4e13-846f-8dc1c3afa211 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1730 microversion: 2.20 time: 0.170454 Aug 10 13:33:09.793204 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 489/981] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:09 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:10.805514 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:10.805514 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:10.811598 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:10.812165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:10.812606 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:10.813346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:10.813802 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:10.814230 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:10.980424 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:10.983457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:10.984964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:10.986198 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-72011951-54c2-4527-87d9-ff7368cf01b0 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1717 microversion: 2.20 time: 0.186383 Aug 10 13:33:10.986746 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 493/982] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:10 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:49.935200 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:33:49.936222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:33:50.152813 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bff14a10-148e-4fa8-b8a4-70369608fd68 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Action: 'create', calling method: .version_select at 0x7ff6a372f3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-533191636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxnNyGeoDnATDwtkDLPAuSRpEbnhri8uBzK5hQN52FsF57q82c2HEcbC/f80DDp2TJq0xL8W5iJMm+SRzG4qGfKdpUjoD9QsySitFW4ksYOhTJXJn3m9MB9zTYmBCC+MQ=="}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:33:50.169494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-bff14a10-148e-4fa8-b8a4-70369608fd68 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Getting quotas for project ded676e84f4145d5912a3878ef9af132. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:33:50.174306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-bff14a10-148e-4fa8-b8a4-70369608fd68 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Getting quotas for user 9675d83e26b647489e4b6195bb814aab and project ded676e84f4145d5912a3878ef9af132. Resources: {'key_pairs'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:33:50.256213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-bff14a10-148e-4fa8-b8a4-70369608fd68 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.325950 Aug 10 13:33:50.256825 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 490/983] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:33:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:33:51.903910 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:51.907781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:51.910919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=19 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:33:51.910919 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SELECT=72 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:33:51.919522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:51.919522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:51.919522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:51.919522 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:51.920472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:51.920472 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:51.949246 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6b960e92-076e-478b-ae7c-8a03a09d24d4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052370 Aug 10 13:33:51.950020 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 494/984] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 10 13:33:51 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:33:52.014928 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:52.020015 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:52.022532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:52.023100 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:52.023613 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:52.024455 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:52.025088 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:52.025524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:52.055858 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:33:52.395220 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5c8429ce-c56d-4249-be7c-e3ed3ed927e2 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 204 len: 0 microversion: 2.20 time: 0.384585 Aug 10 13:33:52.396052 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 491/985] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Aug 10 13:33:52 2022] DELETE /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:33:52.405397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:52.406156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:52.413209 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:52.413987 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:52.414686 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:52.415469 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:52.416149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:52.416718 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:52.577659 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:52.587793 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:52.589501 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:52.591091 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-fef544cf-212f-429c-8e42-d63b13cd25f4 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.190120 Aug 10 13:33:52.592056 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 495/986] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:52 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:53.616966 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:53.617698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:53.628166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:53.628657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:53.629116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:53.630554 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:53.631326 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:53.632039 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:53.777548 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:53.786760 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:53.788869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:53.790075 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-933d1c98-f853-421a-943b-7c43a1493f43 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1723 microversion: 2.20 time: 0.178502 Aug 10 13:33:53.790636 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 492/987] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:53 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:54.814259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:54.814932 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:54.822868 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:54.823484 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:54.823955 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:54.824703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:54.825195 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:54.825619 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:54.899227 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:54.907548 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:54.909375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:54.910557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-582dcfa7-09a1-475a-b0cc-635706b75f38 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1656 microversion: 2.20 time: 0.100231 Aug 10 13:33:54.911144 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 496/988] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:54 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1656 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:55.019042 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-4c7667cc-1889-4923-b563-b55bc54674c3 req-07add210-293f-46fb-a03c-f4cb61d075b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb", "name": "network-vif-deleted", "tag": "fb29def7-e001-4e1b-a67d-f091c1548451"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:33:55.032734 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-4c7667cc-1889-4923-b563-b55bc54674c3 req-07add210-293f-46fb-a03c-f4cb61d075b1 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:55.033568 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-4c7667cc-1889-4923-b563-b55bc54674c3 req-07add210-293f-46fb-a03c-f4cb61d075b1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:55.034273 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-4c7667cc-1889-4923-b563-b55bc54674c3 req-07add210-293f-46fb-a03c-f4cb61d075b1 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:55.048925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-4c7667cc-1889-4923-b563-b55bc54674c3 req-07add210-293f-46fb-a03c-f4cb61d075b1 service nova] Creating event network-vif-deleted:fb29def7-e001-4e1b-a67d-f091c1548451 for instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb on hv-cinder-83602 Aug 10 13:33:55.054739 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-4c7667cc-1889-4923-b563-b55bc54674c3 req-07add210-293f-46fb-a03c-f4cb61d075b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039302 Aug 10 13:33:55.061508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 493/989] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:33:55.934758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:55.936734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:55.948699 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:55.949671 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:55.950337 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:55.951284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:55.951966 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:55.952654 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:56.003390 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:56.003886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:56.004330 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:56.005441 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lazy-loading 'fault' on Instance uuid 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:33:56.052192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:56.062690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:56.064394 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1945fed03f73472db818c4e5ca015eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60a5752fcba46359ef5275f506c933a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:33:56.065713 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7293b501-1a5b-4fa7-a47a-13bb1652323a tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 200 len: 1370 microversion: 2.20 time: 0.135289 Aug 10 13:33:56.066410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 497/990] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:55 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 1370 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:33:56.645839 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:33:56.646090 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:33:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:33:57.094038 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:57.094964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:57.102006 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:57.102760 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:57.103199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:57.104965 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:57.104965 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:57.104965 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:57.119707 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] HTTP exception thrown: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Request method failure captured: Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb HTTP/1.1 Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87Iawk_SGRtFXxAR4dnF9oFgvNnvMCL53p0i0nAIlPLXMVHfcGCRo03F_hZczfUkL5A8Mvam6_bwTRjaQmRPqLccgyyoqsMJrCmSdBx8G4OgyWWVV1JbzR8sbz_jRrT1z-XLedOAnXUeYzVS5vPbQ3D5dPVKEAcHpBvE4KB2iLmPgYg Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:33:57.121390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a60a5752fcba46359ef5275f506c933a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 1945fed03f73472db818c4e5ca015eb7 Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:57.122938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb'} Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:33:57.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:57.127900 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:57.129654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Returning 404 to user: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:33:57.129654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e8d3bded-309e-44f6-8d69-f380dc7f801b tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 404 len: 111 microversion: 2.20 time: 0.036891 Aug 10 13:33:57.129654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 494/991] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:57 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:33:57.136426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-413a2112-85e3-45ea-9f73-51931a585d11 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '.version_select at 0x7ff6a80f0e50>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:57.261096 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-413a2112-85e3-45ea-9f73-51931a585d11 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734203409" status: 204 len: 0 microversion: 2.20 time: 0.129033 Aug 10 13:33:57.265739 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 498/992] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Aug 10 13:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734203409 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:33:59.290760 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:59.291233 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:59.297885 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:59.298307 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:59.298780 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:59.299497 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:59.300015 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:59.300603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:59.317498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] HTTP exception thrown: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Request method failure captured: Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: DELETE /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb HTTP/1.1 Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87Iawk_SGRtFXxAR4dnF9oFgvNnvMCL53p0i0nAIlPLXMVHfcGCRo03F_hZczfUkL5A8Mvam6_bwTRjaQmRPqLccgyyoqsMJrCmSdBx8G4OgyWWVV1JbzR8sbz_jRrT1z-XLedOAnXUeYzVS5vPbQ3D5dPVKEAcHpBvE4KB2iLmPgYg Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:33:59.319139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a60a5752fcba46359ef5275f506c933a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 1945fed03f73472db818c4e5ca015eb7 Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.322581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb'} Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:33:59.323508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.324953 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.326491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Returning 404 to user: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:33:59.326491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-71537645-f81e-4cf2-9ce5-9b7dc62d30cf tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 404 len: 111 microversion: 2.20 time: 0.035228 Aug 10 13:33:59.326491 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 495/993] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Aug 10 13:33:59 2022] DELETE /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:33:59.330608 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:33:59.331223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:33:59.339308 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:59.339798 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:59.340225 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:59.340949 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:33:59.341439 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:33:59.341861 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:33:59.355761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] HTTP exception thrown: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Request method failure captured: Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb HTTP/1.1 Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87Iawk_SGRtFXxAR4dnF9oFgvNnvMCL53p0i0nAIlPLXMVHfcGCRo03F_hZczfUkL5A8Mvam6_bwTRjaQmRPqLccgyyoqsMJrCmSdBx8G4OgyWWVV1JbzR8sbz_jRrT1z-XLedOAnXUeYzVS5vPbQ3D5dPVKEAcHpBvE4KB2iLmPgYg Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:33:59.357453 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a60a5752fcba46359ef5275f506c933a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 1945fed03f73472db818c4e5ca015eb7 Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.359179 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb'} Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:33:59.360290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. Aug 10 13:33:59.361766 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:33:59.363332 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Returning 404 to user: Instance 7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:33:59.363332 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1ebff90c-f34b-454f-b8ba-8a42c326785c tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb" status: 404 len: 111 microversion: 2.20 time: 0.032901 Aug 10 13:33:59.363332 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 499/994] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:33:59 2022] GET /compute/v2.1/servers/7c2bc812-a0be-4c29-8f80-79a2eaf6f4bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:34:00.718591 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:00.719132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:00.721114 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=4 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:00.727716 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:00.727969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:00.728430 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:00.729135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:00.729587 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:00.730008 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:00.743533 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] HTTP exception thrown: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Request method failure captured: Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: DELETE /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 HTTP/1.1 Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87Iawk_SGRtFXxAR4dnF9oFgvNnvMCL53p0i0nAIlPLXMVHfcGCRo03F_hZczfUkL5A8Mvam6_bwTRjaQmRPqLccgyyoqsMJrCmSdBx8G4OgyWWVV1JbzR8sbz_jRrT1z-XLedOAnXUeYzVS5vPbQ3D5dPVKEAcHpBvE4KB2iLmPgYg Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:34:00.744943 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a60a5752fcba46359ef5275f506c933a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 1945fed03f73472db818c4e5ca015eb7 Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.746735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'e88fd6a8-9262-4f5c-9b91-ed4e70704cb9'} Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:34:00.747555 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.749048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.757205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Returning 404 to user: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:34:00.757205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-03048309-b33d-476d-be31-d11f8fb6b7a5 tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 404 len: 111 microversion: 2.20 time: 0.031742 Aug 10 13:34:00.757205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 496/995] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Aug 10 13:34:00 2022] DELETE /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:34:00.757497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:00.757497 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] [instance: e88fd6a8-9262-4f5c-9b91-ed4e70704cb9] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:00.764346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:00.764832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:00.765302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:00.766004 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:00.766458 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:00.766884 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:00.781734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] HTTP exception thrown: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Request method failure captured: Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 HTTP/1.1 Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87Iawk_SGRtFXxAR4dnF9oFgvNnvMCL53p0i0nAIlPLXMVHfcGCRo03F_hZczfUkL5A8Mvam6_bwTRjaQmRPqLccgyyoqsMJrCmSdBx8G4OgyWWVV1JbzR8sbz_jRrT1z-XLedOAnXUeYzVS5vPbQ3D5dPVKEAcHpBvE4KB2iLmPgYg Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:34:00.784274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a60a5752fcba46359ef5275f506c933a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a60a5752fcba46359ef5275f506c933a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: a60a5752fcba46359ef5275f506c933a Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1707552939 Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 1945fed03f73472db818c4e5ca015eb7 Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1707552939-project Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.785929 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': 'e88fd6a8-9262-4f5c-9b91-ed4e70704cb9'} Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:34:00.786694 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. Aug 10 13:34:00.788446 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:34:00.789589 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] Returning 404 to user: Instance e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:34:00.789589 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-77757b3b-afb1-4813-a6fe-29952662afbe tempest-AttachVolumeShelveTestJSON-1707552939 tempest-AttachVolumeShelveTestJSON-1707552939-project] 10.222.0.40 "GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9" status: 404 len: 111 microversion: 2.20 time: 0.033847 Aug 10 13:34:00.789589 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 500/996] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 10 13:34:00 2022] GET /compute/v2.1/servers/e88fd6a8-9262-4f5c-9b91-ed4e70704cb9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:34:10.948035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-92879381", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-533191636", "security_groups": [{"name": "tempest-secgroup-smoke-923273331"}], "block_device_mapping_v2": [{"uuid": "a1c67e58-e24e-4e1b-9fb1-d410f2a480c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d843480-7e1a-4398-be7c-339cb0b79360"}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:10.961158 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:10.962218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:11.111765 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] validate_networks() for [('3d843480-7e1a-4398-be7c-339cb0b79360', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:34:11.640907 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:34:11.641408 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:34:11.641971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:34:11.642970 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:34:11.643401 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:34:11.668300 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:11.673221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:11.676522 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:11.679221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:11.682093 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:11.682093 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:11.702446 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Getting quotas for project ded676e84f4145d5912a3878ef9af132. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:34:11.711218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Getting quotas for user 9675d83e26b647489e4b6195bb814aab and project ded676e84f4145d5912a3878ef9af132. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:34:11.771214 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:34:11.773865 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1c67e58-e24e-4e1b-9fb1-d410f2a480c7',volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:34:12.231909 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a271d7dd-6969-460a-907d-02663508b44f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.290398 Aug 10 13:34:12.239749 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 497/997] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:34:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:34:12.245454 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-47686159-e058-4867-bfdd-324951c1f2a9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:12.246535 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-47686159-e058-4867-bfdd-324951c1f2a9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:12.253097 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:12.254541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=30 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:12.414334 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-47686159-e058-4867-bfdd-324951c1f2a9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:12.425538 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-47686159-e058-4867-bfdd-324951c1f2a9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1092 microversion: 2.1 time: 0.184603 Aug 10 13:34:12.426631 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 501/998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:12 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1092 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:13.449054 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cf72c8e2-8a1c-4a73-9169-2d808230cff0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:13.450360 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cf72c8e2-8a1c-4a73-9169-2d808230cff0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:13.559460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-cf72c8e2-8a1c-4a73-9169-2d808230cff0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:13.575872 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cf72c8e2-8a1c-4a73-9169-2d808230cff0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1092 microversion: 2.1 time: 0.130950 Aug 10 13:34:13.576678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 498/999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:13 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1092 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:14.220055 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-534d37db-3736-4618-9e60-2fa43b4a5bf5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Action: 'create', calling method: .version_select at 0x7ff6a80f0f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-361078310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5fgWgz6sk+nyads/6FjfYWFneQ9IfvXVYmN1LHIWtPU+Kmuo7Vu0VgR5cQzJvk9NklFfwUde1WJTKCDvxqRux8VYXHholyrDfFC/5zIWYMNeDR31iNWFAIthHEOd+Fzg=="}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:14.237532 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-534d37db-3736-4618-9e60-2fa43b4a5bf5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Getting quotas for project 1596bc6318b24822beda3dc89834c7b2. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:34:14.241668 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.quota [None req-534d37db-3736-4618-9e60-2fa43b4a5bf5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Getting quotas for user e4d96e16d368455aa92e1cd62219f106 and project 1596bc6318b24822beda3dc89834c7b2. Resources: {'key_pairs'} {{(pid=118003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:34:14.343964 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-534d37db-3736-4618-9e60-2fa43b4a5bf5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.341988 Aug 10 13:34:14.344543 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 502/1000] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 10 13:34:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:34:14.598084 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:14.598698 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:14.606278 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:14.606764 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:14.607962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:14.607962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:14.608311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:14.608732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:14.685753 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:14.696258 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f21b31b0-8487-4186-bcba-cec56d44b237 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1190 microversion: 2.1 time: 0.102073 Aug 10 13:34:14.700075 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 499/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:14 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:15.718088 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:15.719634 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:15.729337 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:15.730166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:15.730832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:15.732714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:15.733772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:15.734438 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:15.917763 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:15.931660 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a76b2bb6-2d0f-485d-99f2-bf46c1c5f270 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1208 microversion: 2.1 time: 0.218123 Aug 10 13:34:15.933290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 503/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:15 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1208 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:16.970579 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:16.971789 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:16.980075 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:16.980572 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:16.982343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:16.983303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:16.984092 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:16.984703 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:17.116112 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-edb5ad31-8229-4c6e-a67d-365b7c5ef60b req-26270a21-729b-4401-94ed-572dcfe34978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42768bb4-b1d6-48d4-a5b2-18a563b02c22", "tag": "edc3aa5b-e77d-4331-a261-d2cffcd73f71"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:17.133142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-edb5ad31-8229-4c6e-a67d-365b7c5ef60b req-26270a21-729b-4401-94ed-572dcfe34978 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:17.134817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-edb5ad31-8229-4c6e-a67d-365b7c5ef60b req-26270a21-729b-4401-94ed-572dcfe34978 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:17.134817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-edb5ad31-8229-4c6e-a67d-365b7c5ef60b req-26270a21-729b-4401-94ed-572dcfe34978 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:17.151209 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-edb5ad31-8229-4c6e-a67d-365b7c5ef60b req-26270a21-729b-4401-94ed-572dcfe34978 service nova] Creating event network-changed:edc3aa5b-e77d-4331-a261-d2cffcd73f71 for instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 on hv-cinder-83602 Aug 10 13:34:17.153889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:17.164615 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-edb5ad31-8229-4c6e-a67d-365b7c5ef60b req-26270a21-729b-4401-94ed-572dcfe34978 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051442 Aug 10 13:34:17.164891 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-27a339f9-b08a-4f02-82d0-4d5c2bb2c36f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.200151 Aug 10 13:34:17.177025 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 500/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:16 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:17.178393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 504/1004] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:34:18.191828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:18.192510 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:18.200676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:18.201198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:18.201696 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:18.202331 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:18.202800 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:18.203205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:18.339700 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:18.347170 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-feefba1c-0b95-4bd4-9c7e-458ccb26e1a2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.159364 Aug 10 13:34:18.347729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 501/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:18 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:19.368824 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:19.369462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:19.375551 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:19.376033 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:19.376494 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:19.377226 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:19.377680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:19.378101 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:19.619214 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:19.628093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e8053400-a0b3-4c53-ac55-48457e47eed2 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.263797 Aug 10 13:34:19.629176 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 505/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:19 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:20.651843 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:20.652821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:20.666764 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:20.667257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:20.667714 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:20.668426 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:20.668882 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:20.669356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:20.819169 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:20.833303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-4ef0ceea-2bf9-4a56-b99d-9fa55097a38e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.186501 Aug 10 13:34:20.834205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 502/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:20 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:21.859654 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:21.860261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:21.867896 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:21.868375 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:21.868822 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:21.869584 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:21.870046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:21.870474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:22.009099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:22.017397 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3026145a-4377-4287-802c-4a051dea0e7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.161471 Aug 10 13:34:22.018041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 506/1008] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:21 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:23.038800 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:23.039406 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:23.041673 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:23.046423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:23.046905 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:23.047343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:23.048041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:23.048494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:23.048922 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:23.190618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:23.199657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3e77e561-1b8d-425e-8e7d-3257a20f31dd tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.164814 Aug 10 13:34:23.200228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 503/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:23 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:24.220538 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:24.221233 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:24.228494 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:24.228970 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:24.229430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:24.230112 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:24.230561 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:24.230981 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:24.251675 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=6 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:24.368363 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:24.376024 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-02d92624-af50-48d3-a283-28ccf3e9acda tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.159367 Aug 10 13:34:24.376591 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 507/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:24 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:25.399373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:25.400338 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:25.405433 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=8 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:25.415256 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:25.415756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:25.416196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:25.416927 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:25.417396 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:25.417826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:25.559673 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:25.567762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ffe753ce-ee82-4e92-80bb-45c9067e4d00 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.175093 Aug 10 13:34:25.568651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 504/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:25 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:26.588572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:26.589247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:26.595704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:26.596192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:26.596633 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:26.597359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:26.597830 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:26.598258 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:26.738827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:26.747122 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2096433f-eba5-4459-98b6-8cd7c9496085 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.162561 Aug 10 13:34:26.760580 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 508/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:26 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:27.767711 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:27.768323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:27.775549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:27.776036 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:27.776480 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:27.777212 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:27.777674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:27.778106 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:27.912885 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:27.921695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5fe7f5c9-fd79-4346-8ccf-957816f3c555 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.157861 Aug 10 13:34:27.922269 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 505/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:27 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:28.942629 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:28.943279 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:28.950610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:28.951111 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:28.951549 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:28.952298 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:28.952757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:28.953235 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:29.094219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:29.102907 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-74696850-0310-49bc-912d-47b66b1a9dfa tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.163909 Aug 10 13:34:29.103485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 509/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:28 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:30.123735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:30.124340 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:30.130743 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:30.131224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:30.131652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:30.132891 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:30.133381 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:30.133794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:30.275257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:30.282692 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1df3a97e-e3b0-46a6-9a98-10622560b9a1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.162786 Aug 10 13:34:30.283265 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 506/1015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:30 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:31.303704 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:31.305036 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:31.311489 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:31.311979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:31.312418 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:31.313164 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:31.313609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:31.314035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:31.445935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:31.453687 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ef049d58-8909-40bf-ad7c-c4232a1631ff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.154002 Aug 10 13:34:31.454404 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 510/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:31 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:32.478120 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:32.478758 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:32.485311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:32.485793 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:32.486227 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:32.486913 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:32.487367 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:32.487791 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:32.623619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:32.631210 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-45e559ee-3371-4344-8385-2ec6b6931224 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.157097 Aug 10 13:34:32.631894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 507/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:32 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:32.885656 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-1f66cf3c-8f0e-492d-9597-00fc166e76b7 req-e7251601-4957-4df5-8d89-c264426d3f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42768bb4-b1d6-48d4-a5b2-18a563b02c22", "name": "network-vif-plugged", "status": "completed", "tag": "edc3aa5b-e77d-4331-a261-d2cffcd73f71"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:32.897277 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1f66cf3c-8f0e-492d-9597-00fc166e76b7 req-e7251601-4957-4df5-8d89-c264426d3f4f service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:32.897277 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1f66cf3c-8f0e-492d-9597-00fc166e76b7 req-e7251601-4957-4df5-8d89-c264426d3f4f service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:32.897277 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1f66cf3c-8f0e-492d-9597-00fc166e76b7 req-e7251601-4957-4df5-8d89-c264426d3f4f service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:32.908278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-1f66cf3c-8f0e-492d-9597-00fc166e76b7 req-e7251601-4957-4df5-8d89-c264426d3f4f service nova] Creating event network-vif-plugged:edc3aa5b-e77d-4331-a261-d2cffcd73f71 for instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 on hv-cinder-83602 Aug 10 13:34:32.914222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-1f66cf3c-8f0e-492d-9597-00fc166e76b7 req-e7251601-4957-4df5-8d89-c264426d3f4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031557 Aug 10 13:34:32.915259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 511/1018] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:34:33.653759 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:33.654400 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:33.660923 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:33.661423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:33.661852 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:33.662992 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:33.663205 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:33.664130 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:33.796318 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:33.803853 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-61c8d388-cdeb-4005-aa5d-66ef1ac8f216 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.153921 Aug 10 13:34:33.805233 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 508/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:33 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:34.827651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:34.828366 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:34.834921 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:34.835600 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:34.836107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:34.836962 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:34.837459 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:34.838025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:34.985471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:34.993886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b02ebd3e-511f-4557-aa37-e4623eb182e7 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.171274 Aug 10 13:34:34.994463 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 512/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:34 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:36.014579 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:36.015189 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:36.021605 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:36.022080 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:36.022539 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:36.023863 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:36.024313 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:36.024732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:36.153687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:36.161402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e922b2c0-3b4c-4dba-af85-7ebcc21149c1 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.150589 Aug 10 13:34:36.161902 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 509/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:36 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:37.184224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:37.184848 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:37.191454 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:37.192146 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:37.192380 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:37.193109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:37.193570 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:37.193993 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:37.329167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:37.338781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-98b89cf3-0ecb-4a7e-844e-119966b7085b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1263 microversion: 2.1 time: 0.160518 Aug 10 13:34:37.339366 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 513/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:37 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:38.358715 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:38.359324 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:38.365821 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:38.366303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:38.366741 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:38.367930 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:38.368388 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:38.368861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:38.500687 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:38.508794 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-c9c8be0b-ece8-4a47-b23a-65045a1e7323 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1451 microversion: 2.1 time: 0.153422 Aug 10 13:34:38.509571 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 510/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:38 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:38.533351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:38.534333 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:38.540858 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:38.541385 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:38.541828 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:38.542528 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:38.542986 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:38.543413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:38.679360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:38.687278 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d11836bc-c307-4162-9721-ce354ac9c4a6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1451 microversion: 2.1 time: 0.157733 Aug 10 13:34:38.698077 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 514/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:38 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:34:39.125447 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-710750671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-361078310", "security_groups": [{"name": "tempest-secgroup-smoke-310421447"}], "networks": [{"uuid": "469c568a-1998-4b26-bbb1-1dae466847d6"}], "block_device_mapping_v2": [{"uuid": "f6be05f5-0d37-427b-add4-788c98fe422f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:39.254041 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] validate_networks() for [('469c568a-1998-4b26-bbb1-1dae466847d6', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:34:39.633592 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:34:39.634319 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:34:39.635432 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:34:39.635910 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:34:39.637371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:34:39.646805 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:39.647854 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:39.648606 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:39.650356 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:39.651062 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:39.651882 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:39.676188 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Getting quotas for project 1596bc6318b24822beda3dc89834c7b2. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:34:39.680174 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Getting quotas for user e4d96e16d368455aa92e1cd62219f106 and project 1596bc6318b24822beda3dc89834c7b2. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:34:39.745323 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:34:39.748752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6be05f5-0d37-427b-add4-788c98fe422f',volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:34:40.236530 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-bdd90146-fc42-4137-92b5-30a9114b68dd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.115079 Aug 10 13:34:40.237487 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 511/1025] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:34:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:34:40.248412 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e6ec044d-6102-4b0e-8fdf-6a49cfe708b8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:40.249044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e6ec044d-6102-4b0e-8fdf-6a49cfe708b8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:40.331035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e6ec044d-6102-4b0e-8fdf-6a49cfe708b8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:40.338229 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e6ec044d-6102-4b0e-8fdf-6a49cfe708b8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1087 microversion: 2.1 time: 0.093638 Aug 10 13:34:40.338860 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 515/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:40 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1087 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:40.887185 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-e4d27522-bd51-40b0-867c-c540d6a3cb33 req-7c23583b-8a97-4841-8c5e-f603aafd842b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42768bb4-b1d6-48d4-a5b2-18a563b02c22", "tag": "edc3aa5b-e77d-4331-a261-d2cffcd73f71"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:40.898308 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e4d27522-bd51-40b0-867c-c540d6a3cb33 req-7c23583b-8a97-4841-8c5e-f603aafd842b service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:40.899213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e4d27522-bd51-40b0-867c-c540d6a3cb33 req-7c23583b-8a97-4841-8c5e-f603aafd842b service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:40.899213 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-e4d27522-bd51-40b0-867c-c540d6a3cb33 req-7c23583b-8a97-4841-8c5e-f603aafd842b service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:40.910881 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-e4d27522-bd51-40b0-867c-c540d6a3cb33 req-7c23583b-8a97-4841-8c5e-f603aafd842b service nova] Creating event network-changed:edc3aa5b-e77d-4331-a261-d2cffcd73f71 for instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 on hv-cinder-83602 Aug 10 13:34:40.916520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-e4d27522-bd51-40b0-867c-c540d6a3cb33 req-7c23583b-8a97-4841-8c5e-f603aafd842b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034389 Aug 10 13:34:40.921517 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 512/1027] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:34:41.358681 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:41.359428 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:41.366601 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:41.367183 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:41.368234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:41.369016 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:41.369485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:41.369912 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:41.431733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:41.439313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c2da4e49-1443-4062-b1ed-2b0cce9e0fb1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1137 microversion: 2.1 time: 0.084651 Aug 10 13:34:41.439877 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 516/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:41 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:42.462259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:42.462949 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:42.464869 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:42.469718 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:42.470199 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:42.470633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:42.471320 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:42.471855 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:42.472282 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:42.476184 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=79 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:42.536058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:42.544119 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ccace6fe-12b9-496b-8184-0d90c8ed8f8e tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1137 microversion: 2.1 time: 0.086751 Aug 10 13:34:42.544691 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 513/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:42 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:43.565191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:43.565736 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:43.572268 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:43.572758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:43.573430 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:43.574324 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:43.574954 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:43.575388 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:43.662219 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:43.670005 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3cf4dd37-3fbb-4643-a8b8-4da1e75cd16d tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1193 microversion: 2.1 time: 0.108698 Aug 10 13:34:43.670582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 517/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:43 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:44.692287 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:44.693461 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:44.701329 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:44.701809 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:44.702243 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:44.702929 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:44.703377 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:44.703798 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:45.020413 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:45.026193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d28065f2-1061-4674-8426-32d39231910f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1270 microversion: 2.1 time: 0.338322 Aug 10 13:34:45.026769 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 514/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:44 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1270 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:45.359644 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-d4473f45-8fbd-455d-8d13-13b992624c20 req-dd335693-483f-4684-9a69-70053bf6e3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d35bf5-375a-4170-8776-ed97568ead86", "tag": "0247c0bf-49a3-485c-ad43-0169d20f7d82"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:45.370369 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d4473f45-8fbd-455d-8d13-13b992624c20 req-dd335693-483f-4684-9a69-70053bf6e3b5 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:45.371231 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d4473f45-8fbd-455d-8d13-13b992624c20 req-dd335693-483f-4684-9a69-70053bf6e3b5 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:45.371937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-d4473f45-8fbd-455d-8d13-13b992624c20 req-dd335693-483f-4684-9a69-70053bf6e3b5 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:45.376649 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=77 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:45.386313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-d4473f45-8fbd-455d-8d13-13b992624c20 req-dd335693-483f-4684-9a69-70053bf6e3b5 service nova] Creating event network-changed:0247c0bf-49a3-485c-ad43-0169d20f7d82 for instance a7d35bf5-375a-4170-8776-ed97568ead86 on hv-cinder-83602 Aug 10 13:34:45.389078 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-d4473f45-8fbd-455d-8d13-13b992624c20 req-dd335693-483f-4684-9a69-70053bf6e3b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032961 Aug 10 13:34:45.389697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 518/1032] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:34:46.051180 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:46.051812 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:46.059113 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:46.059596 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:46.060133 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:46.060751 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:46.061224 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:46.061648 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:46.193676 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:46.201496 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f6d9db68-bafd-4f2e-9de5-4b09db7eaa95 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.154403 Aug 10 13:34:46.202047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 515/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:46 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:47.224980 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:47.225754 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:47.228059 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:47.233234 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:47.234408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:47.234408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:47.234835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:47.235294 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:47.235723 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:47.370746 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:47.378156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-99b414c7-988a-4454-bd34-33e6d322dee0 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.159045 Aug 10 13:34:47.378721 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 519/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:47 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:48.400166 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:48.400773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:48.406620 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:48.407101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:48.407531 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:48.408219 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:48.408705 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:48.409435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:48.578917 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:48.587263 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e1f5646f-cd54-4f5f-b181-c155a4ea0c1a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.191381 Aug 10 13:34:48.587536 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 516/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:48 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:49.608019 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:49.609213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:49.615834 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:49.616309 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:49.616740 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:49.618244 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:49.618705 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:49.619128 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:49.821624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:49.821624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-89766b96-799c-449f-adf9-a46e6e19d171 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.210718 Aug 10 13:34:49.821624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 520/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:49 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:50.835532 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:50.836286 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:50.838467 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:50.839117 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:50.843930 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:50.852034 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:50.852034 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:50.852034 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:50.852034 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:50.852658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:50.987539 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:50.995428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d72bea40-dfda-4ce4-a516-6999c56a85bd tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.163697 Aug 10 13:34:50.996022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 517/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:50 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:52.017733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:52.018307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:52.020264 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:34:52.026684 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:52.027140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:52.027580 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:52.028275 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:52.028725 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:52.029303 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:52.166546 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:52.174047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-98a475d7-1dcd-4933-bf4b-07bd0763e4a8 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.160203 Aug 10 13:34:52.174608 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 521/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:52 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:53.196001 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:53.196630 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:53.203038 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:53.203514 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:53.203951 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:53.204651 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:53.205139 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:53.205565 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:53.343656 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:53.351055 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3dc2aa59-a9d5-42fb-929e-fba566d06d81 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.159608 Aug 10 13:34:53.352771 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 518/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:53 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:54.372512 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:54.373150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:54.379255 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:54.379733 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:54.380158 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:54.380844 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:54.381315 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:54.381735 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:54.515408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:54.523034 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ee4ac9e7-c8cf-405f-9ee2-8a4ca41f04df tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.154047 Aug 10 13:34:54.524167 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 522/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:54 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:54.918667 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-943c003c-5733-4c58-9f98-bcaa78878d8a req-7866006d-96a9-4bb4-9147-ce4339838019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d35bf5-375a-4170-8776-ed97568ead86", "name": "network-vif-plugged", "status": "completed", "tag": "0247c0bf-49a3-485c-ad43-0169d20f7d82"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:54.934023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-943c003c-5733-4c58-9f98-bcaa78878d8a req-7866006d-96a9-4bb4-9147-ce4339838019 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:54.934508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-943c003c-5733-4c58-9f98-bcaa78878d8a req-7866006d-96a9-4bb4-9147-ce4339838019 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:54.937843 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-943c003c-5733-4c58-9f98-bcaa78878d8a req-7866006d-96a9-4bb4-9147-ce4339838019 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:54.946520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-943c003c-5733-4c58-9f98-bcaa78878d8a req-7866006d-96a9-4bb4-9147-ce4339838019 service nova] Creating event network-vif-plugged:0247c0bf-49a3-485c-ad43-0169d20f7d82 for instance a7d35bf5-375a-4170-8776-ed97568ead86 on hv-cinder-83602 Aug 10 13:34:54.951712 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-943c003c-5733-4c58-9f98-bcaa78878d8a req-7866006d-96a9-4bb4-9147-ce4339838019 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 Aug 10 13:34:54.952309 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 519/1041] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:34:55.543687 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:55.544300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:55.550768 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:55.551250 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:55.551684 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:55.552384 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:55.552842 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:55.553301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:55.686949 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:55.694507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b02dc07b-8391-4125-ac49-1bebb6b2921c tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1258 microversion: 2.1 time: 0.154661 Aug 10 13:34:55.696022 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 523/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:55 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:56.717195 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:56.717884 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:56.724451 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:56.724925 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:56.725449 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:56.726152 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:56.726838 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:56.727377 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:56.862062 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:56.869847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-59ea9cf7-3963-4d86-9805-2a4138e5308a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1442 microversion: 2.1 time: 0.156902 Aug 10 13:34:56.870586 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 520/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:56 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:34:56.896106 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:34:56.896881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:34:56.904485 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:56.904980 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:56.905444 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:56.906150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:56.906793 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:56.907250 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:57.048175 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:34:57.056620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-46079855-5c84-4626-9e16-dd3baab49ba7 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1442 microversion: 2.1 time: 0.164599 Aug 10 13:34:57.057228 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 524/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:34:56 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:34:59.169921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-fb9211a3-84e7-4e3c-b896-f5e63faf1a02 req-d7485918-6e38-4749-99a5-559436817594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d35bf5-375a-4170-8776-ed97568ead86", "tag": "0247c0bf-49a3-485c-ad43-0169d20f7d82"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:34:59.180639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-fb9211a3-84e7-4e3c-b896-f5e63faf1a02 req-d7485918-6e38-4749-99a5-559436817594 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:34:59.181141 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-fb9211a3-84e7-4e3c-b896-f5e63faf1a02 req-d7485918-6e38-4749-99a5-559436817594 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:34:59.181576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-fb9211a3-84e7-4e3c-b896-f5e63faf1a02 req-d7485918-6e38-4749-99a5-559436817594 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:34:59.192855 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-fb9211a3-84e7-4e3c-b896-f5e63faf1a02 req-d7485918-6e38-4749-99a5-559436817594 service nova] Creating event network-changed:0247c0bf-49a3-485c-ad43-0169d20f7d82 for instance a7d35bf5-375a-4170-8776-ed97568ead86 on hv-cinder-83602 Aug 10 13:34:59.200125 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-fb9211a3-84e7-4e3c-b896-f5e63faf1a02 req-d7485918-6e38-4749-99a5-559436817594 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031939 Aug 10 13:34:59.205201 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 521/1045] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:36:44.138035 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=11 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:36:44.138781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=37 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:36:44.142827 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:44.143322 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:44.148968 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:44.149475 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:44.150474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:44.151187 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:44.151638 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:44.152058 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:44.178561 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:36:44.495274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-90c0244b-697f-4a7d-a927-a64b464e80a4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 204 len: 0 microversion: 2.1 time: 0.358673 Aug 10 13:36:44.495863 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 525/1046] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:36:44 2022] DELETE /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:36:44.502118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe555c32-f959-41fc-bcdd-24c022753f97] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 13:36:44.502699 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=17 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:36:44.503428 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=45 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:36:44.507796 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:44.508485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:44.514955 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:44.515527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:44.515974 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:44.516660 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:44.517154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:44.520790 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:44.762616 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:44.770202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a49a71e6-73f1-4f58-bdd5-d18ca6263986 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1576 microversion: 2.1 time: 0.269977 Aug 10 13:36:44.770761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 522/1047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:44 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:45.792881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:45.793610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:45.800134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:45.800623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:45.801107 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:45.801807 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:45.802270 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:45.802697 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:45.992300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:46.000006 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9e5954f2-8250-4ef1-a7c9-98f8fc4cfb3a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1576 microversion: 2.1 time: 0.212032 Aug 10 13:36:46.000575 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 526/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:45 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:47.021123 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:47.021738 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:47.032474 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe555c32-f959-41fc-bcdd-24c022753f97] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 57050. Aug 10 13:36:47.036870 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:47.037388 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:47.037828 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:47.038527 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:47.038985 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:47.039412 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:47.101382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:47.109309 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-31c02c21-5257-4e68-a485-6e847a5243d9 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1509 microversion: 2.1 time: 0.092173 Aug 10 13:36:47.109894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 523/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:47 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1509 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:47.346958 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-e39a64a9-5449-48c0-be7a-c76e1ea3f3cb req-e2826d76-122f-4248-bd60-4fc6e1298a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42768bb4-b1d6-48d4-a5b2-18a563b02c22", "name": "network-vif-deleted", "tag": "edc3aa5b-e77d-4331-a261-d2cffcd73f71"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:36:47.359391 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-e39a64a9-5449-48c0-be7a-c76e1ea3f3cb req-e2826d76-122f-4248-bd60-4fc6e1298a8c service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:47.359978 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-e39a64a9-5449-48c0-be7a-c76e1ea3f3cb req-e2826d76-122f-4248-bd60-4fc6e1298a8c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:47.360421 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-e39a64a9-5449-48c0-be7a-c76e1ea3f3cb req-e2826d76-122f-4248-bd60-4fc6e1298a8c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:47.374249 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-e39a64a9-5449-48c0-be7a-c76e1ea3f3cb req-e2826d76-122f-4248-bd60-4fc6e1298a8c service nova] Creating event network-vif-deleted:edc3aa5b-e77d-4331-a261-d2cffcd73f71 for instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 on hv-cinder-83602 Aug 10 13:36:47.380204 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-e39a64a9-5449-48c0-be7a-c76e1ea3f3cb req-e2826d76-122f-4248-bd60-4fc6e1298a8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107630 Aug 10 13:36:47.384054 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 527/1050] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:36:48.131260 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:48.132036 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:48.139322 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:48.139995 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:48.140445 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:48.141193 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:48.141652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:48.142082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:48.174806 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:48.175301 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:48.175742 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:48.179222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lazy-loading 'fault' on Instance uuid 42768bb4-b1d6-48d4-a5b2-18a563b02c22 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:36:48.222942 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:48.231032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d9bbdd15-ce1e-4bf9-811d-151b0355aeac tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 200 len: 1228 microversion: 2.1 time: 0.103753 Aug 10 13:36:48.231604 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 524/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:48 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 1228 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:49.254500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:49.255221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:49.262236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:49.262716 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:49.263186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:49.263869 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:49.264319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:49.264737 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:49.278618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] HTTP exception thrown: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Request method failure captured: Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 HTTP/1.1 Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87O3CToxm41lD_dw4CCjemPHpXXw_xr1Xkn2fNZchzljgDVzwVzPkVAQtgLIA59VZPzTqyDl1E2NjPiZXInf6ywxlRVFzsvqUHjItZZjoX7wdyXOo7ez5zM4tlE5UQVK7bO5XhBm3h_A3BK3SfgbZ1UdHwO_VL5YCkTFAWxz8TYKsng Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:36:49.280236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ded676e84f4145d5912a3878ef9af132", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 9675d83e26b647489e4b6195bb814aab Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:36:49.282010 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '42768bb4-b1d6-48d4-a5b2-18a563b02c22'} Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:36:49.283025 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:36:49.284888 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:36:49.286525 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Returning 404 to user: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:36:49.286525 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a7f7937f-4eaf-4556-8d60-dd5124cdbf75 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 404 len: 111 microversion: 2.1 time: 0.031705 Aug 10 13:36:49.286525 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 528/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:49 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:36:49.380280 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-917277880", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-533191636", "security_groups": [{"name": "tempest-secgroup-smoke-923273331"}], "block_device_mapping_v2": [{"uuid": "a1c67e58-e24e-4e1b-9fb1-d410f2a480c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d843480-7e1a-4398-be7c-339cb0b79360"}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:36:49.501027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] validate_networks() for [('3d843480-7e1a-4398-be7c-339cb0b79360', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:36:49.924659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:36:49.925124 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:36:49.925603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:36:49.926014 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:36:49.926427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:36:49.935115 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:49.935590 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:49.936022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:49.936743 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:49.937229 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:49.937654 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:49.954893 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Getting quotas for project ded676e84f4145d5912a3878ef9af132. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:36:49.958767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Getting quotas for user 9675d83e26b647489e4b6195bb814aab and project ded676e84f4145d5912a3878ef9af132. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:36:50.017732 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:36:50.019840 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1c67e58-e24e-4e1b-9fb1-d410f2a480c7',volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:36:50.422163 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-24bc9be7-1bad-4c17-9d09-45158b45dd7d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.045628 Aug 10 13:36:50.422829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 525/1053] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:36:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:36:50.434521 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-af517606-794b-4e00-9858-cde5b108a80d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:50.435170 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-af517606-794b-4e00-9858-cde5b108a80d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:50.492091 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-af517606-794b-4e00-9858-cde5b108a80d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:50.502473 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-af517606-794b-4e00-9858-cde5b108a80d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1093 microversion: 2.1 time: 0.072687 Aug 10 13:36:50.503027 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 529/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:50 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:51.024724 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:36:51.024951 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Wed Aug 10 13:36:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:36:51.523448 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-004bb856-a03c-44b8-b7f5-8ce6e39da116 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:51.524118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-004bb856-a03c-44b8-b7f5-8ce6e39da116 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:51.577954 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-004bb856-a03c-44b8-b7f5-8ce6e39da116 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:51.585145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-004bb856-a03c-44b8-b7f5-8ce6e39da116 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1093 microversion: 2.1 time: 0.065962 Aug 10 13:36:51.585786 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 526/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:51 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:52.605830 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3a28937d-c493-4dac-9e5d-297556938f0d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:52.606422 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3a28937d-c493-4dac-9e5d-297556938f0d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:52.658348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3a28937d-c493-4dac-9e5d-297556938f0d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:52.665448 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3a28937d-c493-4dac-9e5d-297556938f0d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1093 microversion: 2.1 time: 0.063406 Aug 10 13:36:52.666183 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 530/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:52 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:53.684936 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-d185da5b-829b-4032-8163-6a65193feb1e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:53.685600 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-d185da5b-829b-4032-8163-6a65193feb1e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:53.738709 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-d185da5b-829b-4032-8163-6a65193feb1e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:53.745408 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-d185da5b-829b-4032-8163-6a65193feb1e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1093 microversion: 2.1 time: 0.064297 Aug 10 13:36:53.746209 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 527/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:53 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:54.768344 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:54.769020 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:54.776776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:54.777289 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:54.777720 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:54.778403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:54.778853 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:54.779271 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:54.839599 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:54.847021 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-275ef144-9357-4cbf-b48d-14f9ebcd5bcf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1143 microversion: 2.1 time: 0.082547 Aug 10 13:36:54.847571 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 531/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:54 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:55.868962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:55.869623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:55.877140 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:55.877620 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:55.878052 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:55.878729 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:55.879177 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:55.879596 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:55.945190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:55.952737 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1e4ec052-34d7-4adf-ad4e-d45767c6bc3b tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1135 microversion: 2.1 time: 0.087613 Aug 10 13:36:55.953321 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 528/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:55 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1135 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:56.973503 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:56.974100 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:56.981351 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:56.981866 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:56.982299 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:56.982999 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:56.983442 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:56.983864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:57.061031 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:57.068452 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-3a9a3e36-4726-485e-bae5-7fc69a85f52e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1209 microversion: 2.1 time: 0.098786 Aug 10 13:36:57.071886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 532/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:56 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:58.065602 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-baa1f5a0-3182-40a8-b588-7683176d4bcd req-808264a0-364c-4442-8e64-d8cf01e60f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7117f6d5-204e-41fb-93cc-bbf6038d9f59", "tag": "b1e40f7b-f66b-468c-9f7b-93199f918abf"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:36:58.076176 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-baa1f5a0-3182-40a8-b588-7683176d4bcd req-808264a0-364c-4442-8e64-d8cf01e60f9e service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:58.076802 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-baa1f5a0-3182-40a8-b588-7683176d4bcd req-808264a0-364c-4442-8e64-d8cf01e60f9e service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:58.077265 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-baa1f5a0-3182-40a8-b588-7683176d4bcd req-808264a0-364c-4442-8e64-d8cf01e60f9e service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:58.088971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-baa1f5a0-3182-40a8-b588-7683176d4bcd req-808264a0-364c-4442-8e64-d8cf01e60f9e service nova] Creating event network-changed:b1e40f7b-f66b-468c-9f7b-93199f918abf for instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 on hv-cinder-83602 Aug 10 13:36:58.092743 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:58.093368 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:58.095173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-baa1f5a0-3182-40a8-b588-7683176d4bcd req-808264a0-364c-4442-8e64-d8cf01e60f9e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033356 Aug 10 13:36:58.096035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 529/1061] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:36:58.100044 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:58.100707 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:58.101192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:58.102065 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:58.102517 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:58.102937 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:58.315900 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:58.323290 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d162ac50-a90d-4749-a169-879c17f35f31 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.235167 Aug 10 13:36:58.325009 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 533/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:58 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:36:59.346327 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:36:59.347022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:36:59.353206 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:59.353695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:59.354135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:59.355500 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:59.356002 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:59.356417 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:59.488440 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:36:59.496046 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-84fcae29-7295-4ec2-9fe5-079dab582f78 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.154351 Aug 10 13:36:59.496761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 530/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:36:59 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:00.517455 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:00.518046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:00.524308 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:00.524781 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:00.525247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:00.525927 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:00.526382 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:00.527186 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:00.661136 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:00.669378 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-46fe6231-53da-4be1-a158-b493fbbb52c0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.155736 Aug 10 13:37:00.669950 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 534/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:00 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:01.690185 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:01.690823 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:01.692742 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:01.697992 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:01.698483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:01.699185 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:01.699829 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:01.700290 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:01.700774 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:01.834218 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:01.841608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-76ec2d63-21a6-4c62-bf34-5d5cf95ec935 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.155310 Aug 10 13:37:01.842160 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 531/1065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:01 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:02.862223 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:02.862837 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:02.865246 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=4 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:02.869971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:02.870492 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:02.871018 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:02.871620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:02.872072 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:02.872494 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:03.002612 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:03.009957 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-67eccfe3-6f60-4923-a30b-f91bec7f8eff tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.151598 Aug 10 13:37:03.010509 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 535/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:02 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:04.031027 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:04.031641 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:04.034896 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=10 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:04.039736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:04.040225 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:04.040662 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:04.041390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:04.041851 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:04.042304 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:04.172186 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:04.179652 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-10e62869-b8d3-4cca-82ae-ecc1143257d6 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.153141 Aug 10 13:37:04.180214 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 532/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:04 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:05.200669 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:05.201302 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:05.207701 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:05.208185 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:05.208613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:05.209471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:05.209924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:05.210348 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:05.340932 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:05.348220 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-122e1e49-f0f9-4cf0-9653-7837dafa6eca tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.151613 Aug 10 13:37:05.348786 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 536/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:05 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:06.369948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:06.370614 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:06.376961 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:06.377466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:06.377894 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:06.378574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:06.379020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:06.379437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:06.508056 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:06.516067 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-79ad4caa-9016-4716-9fe9-7a93138be45e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.150244 Aug 10 13:37:06.516618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 533/1069] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:06 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:07.219072 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:07.219610 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:07.226037 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:07.226520 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:07.226956 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:07.227647 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:07.228099 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:07.228520 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:07.250404 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lazy-loading 'flavor' on Instance uuid a7d35bf5-375a-4170-8776-ed97568ead86 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:37:07.498176 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5e7247d2-b14d-4db4-a4a6-7e6930abcf48 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "POST /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86/action" status: 202 len: 0 microversion: 2.1 time: 0.283603 Aug 10 13:37:07.498776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 537/1070] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:37:07 2022] POST /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:37:07.506877 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:07.508316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:07.516358 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:07.516847 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:07.517335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:07.518043 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:07.518502 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:07.518926 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:07.537043 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:07.537765 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:07.543912 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:07.544393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:07.544831 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:07.545544 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:07.545996 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:07.547120 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:07.659964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:07.668489 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6539d913-2660-43a7-b0a2-0aeaf66a9a84 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.165285 Aug 10 13:37:07.669070 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 534/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:07 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:07.711093 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:07.733306 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-51bf3f96-7aa9-40a9-b566-98257fbf9096 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.200638 Aug 10 13:37:07.733896 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 538/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:07 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:37:08.689632 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:08.690236 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:08.696781 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:08.697300 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:08.697730 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:08.699057 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:08.699618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:08.700047 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:08.754457 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:08.755105 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:08.762182 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:08.766636 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:08.766636 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:08.766636 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:08.766636 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:08.767560 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:08.844719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:08.852756 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b11270eb-1a13-4825-b834-ffdd731e7bd1 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.166944 Aug 10 13:37:08.855093 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 535/1073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:08 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:08.902102 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:08.909832 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b44bf651-aa4a-4c13-9b41-ea8a99df33a3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.158982 Aug 10 13:37:08.910402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 539/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:08 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:37:09.243893 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:37:09.244098 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:37:09.580287 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-a22a20b0-b71d-4c10-b1c8-4a9822b90ae2 req-d2e64b85-f51c-4940-a5a8-1bba61012719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7117f6d5-204e-41fb-93cc-bbf6038d9f59", "name": "network-vif-plugged", "status": "completed", "tag": "b1e40f7b-f66b-468c-9f7b-93199f918abf"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:09.589808 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-a22a20b0-b71d-4c10-b1c8-4a9822b90ae2 req-d2e64b85-f51c-4940-a5a8-1bba61012719 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:09.590286 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-a22a20b0-b71d-4c10-b1c8-4a9822b90ae2 req-d2e64b85-f51c-4940-a5a8-1bba61012719 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:09.590762 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-a22a20b0-b71d-4c10-b1c8-4a9822b90ae2 req-d2e64b85-f51c-4940-a5a8-1bba61012719 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:09.601857 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-a22a20b0-b71d-4c10-b1c8-4a9822b90ae2 req-d2e64b85-f51c-4940-a5a8-1bba61012719 service nova] Creating event network-vif-plugged:b1e40f7b-f66b-468c-9f7b-93199f918abf for instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 on hv-cinder-83602 Aug 10 13:37:09.607009 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-a22a20b0-b71d-4c10-b1c8-4a9822b90ae2 req-d2e64b85-f51c-4940-a5a8-1bba61012719 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089505 Aug 10 13:37:09.607594 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 536/1075] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:37:09.873791 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:09.874402 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:09.880942 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:09.881461 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:09.881899 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:09.882595 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:09.883052 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:09.883479 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:09.931892 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:09.932973 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:09.939453 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:09.940039 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:09.940554 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:09.941355 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:09.941896 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:09.942390 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:10.049568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:10.057113 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5b45114c-5954-4efc-9229-34398e26410f tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.187179 Aug 10 13:37:10.057677 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 540/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:09 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:10.088864 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:10.096776 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5a913b0e-7bad-441d-b93d-b424ace00cb0 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.169805 Aug 10 13:37:10.097397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 537/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:09 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:37:11.078691 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:11.079300 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:11.085773 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:11.086251 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:11.086762 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:11.087449 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:11.087901 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:11.088327 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:11.093411 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:11.116644 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:11.117288 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:11.124082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:11.124784 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:11.125257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:11.125989 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:11.126504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:11.126934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:11.225130 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:11.233073 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-182263a2-e2ca-4f3d-98a3-0e6bd6102367 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.158316 Aug 10 13:37:11.233651 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 541/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:11 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:11.262072 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:11.269617 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-3f13a1e7-7579-4c22-a1e8-b94527ddf796 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1264 microversion: 2.1 time: 0.156849 Aug 10 13:37:11.270167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 538/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:11 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:37:12.254106 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:12.254652 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:12.261731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:12.262213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:12.262648 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:12.263347 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:12.263822 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:12.264256 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:12.291179 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:12.291817 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:12.299133 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:12.299619 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:12.300058 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:12.300751 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:12.301232 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:12.301659 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:12.402540 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:12.410568 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-1d7dd3af-dc9f-4c72-a84b-6a68a0cabf9b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.160436 Aug 10 13:37:12.418553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 542/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:12 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:12.441524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:12.449202 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0075121f-ab54-45bc-8d31-b0644a606217 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1451 microversion: 2.1 time: 0.161864 Aug 10 13:37:12.449764 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 539/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:12 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:37:12.472117 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:12.472717 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:12.478620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:12.479100 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:12.480063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:12.480924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:12.481401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:12.481822 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:12.652462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:12.652462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a7e919e4-2d68-47c8-9843-a1ae0b89ef77 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1451 microversion: 2.1 time: 0.149966 Aug 10 13:37:12.652462 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 543/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:12 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:13.432029 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:13.433167 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:13.439577 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:13.440108 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:13.440558 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:13.441318 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:13.441805 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:13.442235 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:13.579245 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:13.586969 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f4814097-c4f7-449b-8cd3-3324d161e738 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.159048 Aug 10 13:37:13.587552 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 540/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:13 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:14.605775 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6ae2f1f7-7a48-4e06-aa0e-47e79cf9a376] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 13:37:14.609324 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:14.609931 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:14.611928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:14.616530 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:14.617041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:14.617483 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:14.620618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:14.621151 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:14.621596 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:14.769507 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-40338556-9db8-4cc3-8593-074e5fe17445 req-65cb28a9-db6d-4298-861e-3e7fd32bf333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7117f6d5-204e-41fb-93cc-bbf6038d9f59", "tag": "b1e40f7b-f66b-468c-9f7b-93199f918abf"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:14.775934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:14.779780 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-40338556-9db8-4cc3-8593-074e5fe17445 req-65cb28a9-db6d-4298-861e-3e7fd32bf333 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:14.780463 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-40338556-9db8-4cc3-8593-074e5fe17445 req-65cb28a9-db6d-4298-861e-3e7fd32bf333 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:14.781112 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-40338556-9db8-4cc3-8593-074e5fe17445 req-65cb28a9-db6d-4298-861e-3e7fd32bf333 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:14.785246 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=93 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:14.789150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:14.793843 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-40338556-9db8-4cc3-8593-074e5fe17445 req-65cb28a9-db6d-4298-861e-3e7fd32bf333 service nova] Creating event network-changed:b1e40f7b-f66b-468c-9f7b-93199f918abf for instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 on hv-cinder-83602 Aug 10 13:37:14.797672 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ea6ba9c6-24de-40d6-a047-6528094ff5b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.193813 Aug 10 13:37:14.799464 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-40338556-9db8-4cc3-8593-074e5fe17445 req-65cb28a9-db6d-4298-861e-3e7fd32bf333 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033628 Aug 10 13:37:14.800719 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 541/1084] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:37:14.811857 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 544/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:14 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:15.822051 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:15.822844 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:15.831393 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:15.831921 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:15.832333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:15.833054 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:15.833504 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:15.833924 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:15.967934 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:15.975453 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-ee7e9002-a63d-4521-ba2f-354ae2df7ce5 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.159517 Aug 10 13:37:15.976222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 542/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:15 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:16.654150 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:37:16.654599 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:37:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:37:16.998619 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:16.999171 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:17.008017 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:17.008495 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:17.008924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:17.009635 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:17.010084 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:17.010505 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:17.015771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] [6ae2f1f7-7a48-4e06-aa0e-47e79cf9a376] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 57180. Aug 10 13:37:17.145386 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:17.153556 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b6934a9f-b9cd-4b96-8e2b-ab8ce1e27b82 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.159462 Aug 10 13:37:17.154118 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 545/1087] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:16 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:18.175558 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:18.176173 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:18.182963 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:18.183462 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:18.183909 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:18.184603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:18.185086 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:18.185517 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:18.318415 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:18.326024 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-09bf7841-c385-4604-ad81-8e2e84f656c2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.154417 Aug 10 13:37:18.326581 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 543/1088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:18 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:19.351474 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:19.352089 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:19.358708 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:19.359193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:19.359640 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:19.360336 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:19.360793 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:19.361251 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:19.496715 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:19.504147 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-338797a0-f8ef-4831-9514-5ee78e9c55b6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.156708 Aug 10 13:37:19.504701 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 546/1089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:19 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:20.527371 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:20.527981 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:20.534695 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:20.535172 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:20.535605 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:20.536292 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:20.536742 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:20.537196 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:20.668779 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:20.676314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b31e44a3-18b9-4430-9b21-ad1c8475a14a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.153565 Aug 10 13:37:20.676875 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 544/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:20 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:21.698574 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:21.699190 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:21.705552 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:21.706033 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:21.706464 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:21.707149 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:21.707607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:21.708028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:21.838320 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:21.846360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-f33fae57-dd59-4b24-a33b-05cdb614e460 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1508 microversion: 2.1 time: 0.151855 Aug 10 13:37:21.846924 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 547/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:21 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:21.867242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:21.874639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:21.874639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:21.874639 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:21.875079 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:21.875773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:21.876228 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:21.876658 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:21.905089 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118002) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 13:37:22.124233 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-8b5fa96e-19a4-4604-baf1-131c7e7a0128 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "POST /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86/action" status: 202 len: 0 microversion: 2.1 time: 0.260819 Aug 10 13:37:22.125182 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 545/1092] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 10 13:37:21 2022] POST /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:37:22.132738 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:22.133909 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:22.140046 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:22.140532 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:22.140972 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:22.141690 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:22.142146 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:22.142572 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:22.279360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:22.287203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7649bfac-970d-47ee-ad8d-2393ff1b443b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1516 microversion: 2.1 time: 0.158224 Aug 10 13:37:22.287853 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 548/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:22 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:23.309423 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:23.309972 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:23.315849 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:23.316333 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:23.316773 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:23.317493 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:23.317962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:23.318388 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:23.452020 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:23.459736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1baa88bd-c44a-49bd-ab04-86b69e56fb13 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1518 microversion: 2.1 time: 0.155348 Aug 10 13:37:23.460308 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 546/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:23 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:23.473850 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-9739af6d-1fd7-4bf5-93c7-4e31ce9437a3 req-e1b0cdcf-7c4d-4a05-9e2b-bcfef7a03ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d35bf5-375a-4170-8776-ed97568ead86", "name": "network-vif-unplugged", "status": "completed", "tag": "0247c0bf-49a3-485c-ad43-0169d20f7d82"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:23.476881 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-9739af6d-1fd7-4bf5-93c7-4e31ce9437a3 req-e1b0cdcf-7c4d-4a05-9e2b-bcfef7a03ffe service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:23.477386 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-9739af6d-1fd7-4bf5-93c7-4e31ce9437a3 req-e1b0cdcf-7c4d-4a05-9e2b-bcfef7a03ffe service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:23.477825 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-9739af6d-1fd7-4bf5-93c7-4e31ce9437a3 req-e1b0cdcf-7c4d-4a05-9e2b-bcfef7a03ffe service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:23.489770 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.compute.server_external_events [req-9739af6d-1fd7-4bf5-93c7-4e31ce9437a3 req-e1b0cdcf-7c4d-4a05-9e2b-bcfef7a03ffe service nova] Unable to find a host for instance a7d35bf5-375a-4170-8776-ed97568ead86. Dropping event network-vif-unplugged {{(pid=118003) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 13:37:23.490624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-9739af6d-1fd7-4bf5-93c7-4e31ce9437a3 req-e1b0cdcf-7c4d-4a05-9e2b-bcfef7a03ffe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027383 Aug 10 13:37:23.491194 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 549/1095] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 13:37:24.481701 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:24.482292 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:24.488602 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:24.489111 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:24.489544 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:24.490222 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:24.490673 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:24.491089 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:24.627071 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:24.634673 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-95799a10-464f-4a58-98c2-a06d41be01a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.157140 Aug 10 13:37:24.635855 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 547/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:24 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:25.656211 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:25.656845 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:25.663519 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:25.663997 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:25.664426 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:25.665134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:25.665585 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:25.666003 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:25.796188 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:25.803657 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-e270b47a-87d8-42bf-bdb6-1f5771f1ed44 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.151313 Aug 10 13:37:25.804213 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 550/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:25 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:26.827489 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:26.828506 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:26.837382 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:26.837860 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:26.838802 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:26.839561 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:26.840036 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:26.840457 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:26.992552 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:27.000102 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-6eb04c91-b64f-42cb-971e-37b59526c394 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.178836 Aug 10 13:37:27.000612 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 548/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:26 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:28.026980 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:28.027629 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:28.034196 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:28.034928 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:28.035361 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:28.036051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:28.036507 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:28.036926 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:28.170811 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:28.178273 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b86421ee-250c-41a8-8dde-8e1c88601951 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.156237 Aug 10 13:37:28.178836 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 551/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:28 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:29.199972 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:29.200556 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:29.207013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:29.207498 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:29.207938 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:29.208625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:29.209112 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:29.209537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:29.341092 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:29.348502 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-bc9dea5a-b8e1-4f18-a09b-506b949beff6 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.152653 Aug 10 13:37:29.349082 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 549/1100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:29 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:30.370057 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:30.370680 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:30.377063 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:30.377550 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:30.377991 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:30.378683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:30.379134 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:30.379557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:30.506516 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:30.514582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-11f26670-8ae2-4311-af72-58e8b6cac109 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.148523 Aug 10 13:37:30.515146 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 552/1101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:30 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:31.535871 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:31.536482 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:31.542904 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:31.543386 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:31.543826 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:31.544518 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:31.544966 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:31.545418 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:31.678355 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:31.686609 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-0bff97db-b12c-4070-b54f-8ce74c99a894 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.154834 Aug 10 13:37:31.687170 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 550/1102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:31 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:32.707576 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:32.712008 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:32.714683 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:32.715165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:32.715601 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:32.716296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:32.716751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:32.717210 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:32.879749 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:32.887407 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ffd4cdc1-e23f-4dfe-80d5-bdb7c985190b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.183748 Aug 10 13:37:32.887971 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 553/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:32 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:33.908783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:33.909690 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:33.916902 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:33.917364 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:33.917966 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:33.918664 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:33.919121 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:33.919549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:34.054595 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:34.062454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-107a5447-04d2-4f42-be81-4a02e259b180 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.157574 Aug 10 13:37:34.063257 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 551/1104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:33 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:35.083727 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:35.084334 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:35.092359 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:35.093037 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:35.093682 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:35.104620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:35.104620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:35.104620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:35.226471 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:35.234549 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5eace7ac-d4b7-423f-bf7e-9d46201bd61b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.154727 Aug 10 13:37:35.235113 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 554/1105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:35 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:35.590697 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-c4f2d71a-68d6-4150-a7c9-25d982e2682e req-25312ccf-e726-4871-97c6-e2201c972732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d35bf5-375a-4170-8776-ed97568ead86", "name": "network-vif-plugged", "status": "completed", "tag": "0247c0bf-49a3-485c-ad43-0169d20f7d82"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:35.600362 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-c4f2d71a-68d6-4150-a7c9-25d982e2682e req-25312ccf-e726-4871-97c6-e2201c972732 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:35.600843 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-c4f2d71a-68d6-4150-a7c9-25d982e2682e req-25312ccf-e726-4871-97c6-e2201c972732 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:35.601328 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-c4f2d71a-68d6-4150-a7c9-25d982e2682e req-25312ccf-e726-4871-97c6-e2201c972732 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:35.612416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-c4f2d71a-68d6-4150-a7c9-25d982e2682e req-25312ccf-e726-4871-97c6-e2201c972732 service nova] Creating event network-vif-plugged:0247c0bf-49a3-485c-ad43-0169d20f7d82 for instance a7d35bf5-375a-4170-8776-ed97568ead86 on hv-cinder-83602 Aug 10 13:37:35.617573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-c4f2d71a-68d6-4150-a7c9-25d982e2682e req-25312ccf-e726-4871-97c6-e2201c972732 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031186 Aug 10 13:37:35.618146 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 552/1106] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:37:36.255518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:36.256051 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:36.263232 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:36.263712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:36.264140 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:36.264823 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:36.265317 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:36.265738 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:36.398703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:36.407153 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ae6a9a12-98b9-4fe3-8f66-f2324bd89f41 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1574 microversion: 2.1 time: 0.155569 Aug 10 13:37:36.407720 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 555/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:36 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:37.430094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:37.430779 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:37.437230 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:37.437706 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:37.438137 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:37.438820 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:37.439272 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:37.439697 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:37.575012 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:37.583443 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f543fbf9-3a54-43be-bf8f-8ff80e012dac tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1561 microversion: 2.1 time: 0.158053 Aug 10 13:37:37.584022 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 553/1108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:37 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:57.254448 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:57.255376 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:57.259101 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-cbc715b8-d32d-4c61-8079-36bcdbd91814 req-cdc4130f-e3d7-41d8-9408-cffee4d33d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d35bf5-375a-4170-8776-ed97568ead86", "tag": "0247c0bf-49a3-485c-ad43-0169d20f7d82"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:57.264673 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:57.265221 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:57.268162 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=23 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:57.268894 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=84 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:57.273860 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:57.274357 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:57.274797 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:57.275500 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:57.275671 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cbc715b8-d32d-4c61-8079-36bcdbd91814 req-cdc4130f-e3d7-41d8-9408-cffee4d33d5c service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:57.275959 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:57.276161 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cbc715b8-d32d-4c61-8079-36bcdbd91814 req-cdc4130f-e3d7-41d8-9408-cffee4d33d5c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:57.276559 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-cbc715b8-d32d-4c61-8079-36bcdbd91814 req-cdc4130f-e3d7-41d8-9408-cffee4d33d5c service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:57.276865 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:57.289200 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-cbc715b8-d32d-4c61-8079-36bcdbd91814 req-cdc4130f-e3d7-41d8-9408-cffee4d33d5c service nova] Creating event network-changed:0247c0bf-49a3-485c-ad43-0169d20f7d82 for instance a7d35bf5-375a-4170-8776-ed97568ead86 on hv-cinder-83602 Aug 10 13:38:57.294674 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-cbc715b8-d32d-4c61-8079-36bcdbd91814 req-cdc4130f-e3d7-41d8-9408-cffee4d33d5c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041827 Aug 10 13:38:57.295266 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 554/1109] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:57.304358 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:38:57.619169 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-a75cbe59-b3d7-4084-96a2-821902fb81fb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 204 len: 0 microversion: 2.1 time: 0.369253 Aug 10 13:38:57.619771 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 556/1110] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:38:57 2022] DELETE /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:38:57.635962 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:57.636670 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:57.645520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:57.646279 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:57.646431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:57.647155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:57.647691 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:57.648048 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:57.787861 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:57.795912 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-5fa9efd3-c85a-417d-8be8-1d5784f286a2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.171527 Aug 10 13:38:57.796529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 555/1111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:57 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:58.818012 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:58.818706 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:58.825142 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:58.825623 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:58.826053 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:58.826738 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:58.827191 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:58.827618 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:58.957622 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:58.965289 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-2844bfc1-905e-4dcf-8405-64f7b3e3c3b2 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.151482 Aug 10 13:38:58.965864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 557/1112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:58 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:59.987765 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:59.988524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:59.995123 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:59.995603 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:59.996039 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:59.996736 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:59.997220 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:59.997642 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:00.134735 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:00.142573 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9ef35887-dbe3-4e31-8caf-dc6c10387bd4 tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1567 microversion: 2.1 time: 0.159474 Aug 10 13:39:00.143136 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 556/1113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:59 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:00.511805 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-0f3f0009-3955-4834-ba4d-37b4617ebb88 req-134ed168-fa3f-4983-bc6e-e5d78babc5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d35bf5-375a-4170-8776-ed97568ead86", "name": "network-vif-deleted", "tag": "0247c0bf-49a3-485c-ad43-0169d20f7d82"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:00.522210 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-0f3f0009-3955-4834-ba4d-37b4617ebb88 req-134ed168-fa3f-4983-bc6e-e5d78babc5e2 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:00.522685 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-0f3f0009-3955-4834-ba4d-37b4617ebb88 req-134ed168-fa3f-4983-bc6e-e5d78babc5e2 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:00.523135 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-0f3f0009-3955-4834-ba4d-37b4617ebb88 req-134ed168-fa3f-4983-bc6e-e5d78babc5e2 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:00.534388 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-0f3f0009-3955-4834-ba4d-37b4617ebb88 req-134ed168-fa3f-4983-bc6e-e5d78babc5e2 service nova] Creating event network-vif-deleted:0247c0bf-49a3-485c-ad43-0169d20f7d82 for instance a7d35bf5-375a-4170-8776-ed97568ead86 on hv-cinder-83602 Aug 10 13:39:00.539751 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-0f3f0009-3955-4834-ba4d-37b4617ebb88 req-134ed168-fa3f-4983-bc6e-e5d78babc5e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031591 Aug 10 13:39:00.540340 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 558/1114] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:01.166373 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:01.166914 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:01.173846 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:01.174322 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:01.174755 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:01.175435 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:01.175888 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:01.176303 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:01.241023 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:01.248562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-9fd62ff8-8dda-4eff-829b-2d1ae28273cf tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1218 microversion: 2.1 time: 0.086178 Aug 10 13:39:01.249145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 557/1115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:01 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:02.270969 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:02.271723 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:02.277800 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:02.278281 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:02.278713 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:02.279403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:02.279858 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:02.280285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:02.342245 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:02.350122 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-8bcbce7a-afb4-4492-90ad-be39cb0b5d6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1218 microversion: 2.1 time: 0.083824 Aug 10 13:39:02.350687 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 559/1116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:02 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:03.038995 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-35111231", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-533191636", "security_groups": [{"name": "tempest-secgroup-smoke-923273331"}], "block_device_mapping_v2": [{"uuid": "a818fb59-9707-4a56-b634-77206600c3b8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d843480-7e1a-4398-be7c-339cb0b79360"}]}} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:03.150582 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.network.neutron [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] validate_networks() for [('3d843480-7e1a-4398-be7c-339cb0b79360', None, None, None, None, None)] {{(pid=118002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:39:03.370203 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:03.370836 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:03.377808 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:03.378284 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:03.378714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:03.379393 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:03.379842 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:03.380261 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:03.411356 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:03.411886 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:03.412319 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:03.412764 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lazy-loading 'fault' on Instance uuid a7d35bf5-375a-4170-8776-ed97568ead86 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:39:03.458047 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d96e16d368455aa92e1cd62219f106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1596bc6318b24822beda3dc89834c7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:03.466274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-6db13ed6-45a1-43d2-8021-24ef2e456e8a tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 200 len: 1223 microversion: 2.1 time: 0.099810 Aug 10 13:39:03.466846 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 560/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:03 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:03.530473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Flavor limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:39:03.531033 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Image limits 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:39:03.531608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Flavor pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:39:03.532035 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Image pref 0:0:0 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:39:03.532460 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.virt.hardware [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:39:03.541948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:03.542437 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:03.542870 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:03.543604 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:03.544065 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:03.544500 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:03.562402 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Getting quotas for project ded676e84f4145d5912a3878ef9af132. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:39:03.566746 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.quota [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Getting quotas for user 9675d83e26b647489e4b6195bb814aab and project ded676e84f4145d5912a3878ef9af132. Resources: {'instances', 'ram', 'cores'} {{(pid=118002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:39:03.623964 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Going to run 1 instances... {{(pid=118002) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:39:03.626259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a818fb59-9707-4a56-b634-77206600c3b8',volume_size=None,volume_type=None)] {{(pid=118002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:39:04.092516 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-578e428d-971f-4162-856d-c2dc6713ea01 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.057646 Aug 10 13:39:04.093524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 558/1118] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 10 13:39:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:39:04.104068 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-ba6224eb-639f-4780-8148-39938338537e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:04.104678 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-ba6224eb-639f-4780-8148-39938338537e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:04.160156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-ba6224eb-639f-4780-8148-39938338537e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:04.167692 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-ba6224eb-639f-4780-8148-39938338537e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1092 microversion: 2.1 time: 0.067565 Aug 10 13:39:04.168259 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 561/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:04 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:04.488044 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:04.488752 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] [instance: a7d35bf5-375a-4170-8776-ed97568ead86] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:04.494912 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:04.495392 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:04.495852 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:04.496568 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:04.497026 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:04.497454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:04.511537 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] HTTP exception thrown: Instance a7d35bf5-375a-4170-8776-ed97568ead86 could not be found. Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Request method failure captured: Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 HTTP/1.1 Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87PORlPwlDp-E35Liw9ASbHhYWMfIyuWiFOqo9cDE2Lm_hOuVJhQru1NkI-pye8_R0dPHVWSFSUqVU_s5Ihu-P4Hk77JTc1ntrJJRsS4ioZ1zRXUz64sMaEMCbVv4bgsupqmtunuLHHRKGJHLAOzaS8ttxTOyxkEFb3MwWAUBkP-WPo Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: 1596bc6318b24822beda3dc89834c7b2 Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-TestShelveInstance-1771124587 Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:39:04.513198 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1596bc6318b24822beda3dc89834c7b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1596bc6318b24822beda3dc89834c7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1596bc6318b24822beda3dc89834c7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1596bc6318b24822beda3dc89834c7b2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-TestShelveInstance-1771124587 Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: 1596bc6318b24822beda3dc89834c7b2 Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-TestShelveInstance-1771124587 Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-TestShelveInstance-1771124587-project Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: e4d96e16d368455aa92e1cd62219f106 Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-TestShelveInstance-1771124587-project Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance a7d35bf5-375a-4170-8776-ed97568ead86 could not be found. Aug 10 13:39:04.515050 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': 'a7d35bf5-375a-4170-8776-ed97568ead86'} Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d35bf5-375a-4170-8776-ed97568ead86 could not be found. Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:39:04.515948 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d35bf5-375a-4170-8776-ed97568ead86 could not be found. Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d35bf5-375a-4170-8776-ed97568ead86 could not be found. Aug 10 13:39:04.517777 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:39:04.519244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Returning 404 to user: Instance a7d35bf5-375a-4170-8776-ed97568ead86 could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:39:04.519244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-58b77e32-488a-41bf-807d-f069f49e7b6b tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86" status: 404 len: 111 microversion: 2.1 time: 0.031159 Aug 10 13:39:04.519244 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 559/1120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:04 2022] GET /compute/v2.1/servers/a7d35bf5-375a-4170-8776-ed97568ead86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:39:04.748310 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c77f5159-beb3-4595-add7-39ce28d89ceb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] Calling method '.version_select at 0x7ff6a8099b80>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:04.831981 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c77f5159-beb3-4595-add7-39ce28d89ceb tempest-TestShelveInstance-1771124587 tempest-TestShelveInstance-1771124587-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-361078310" status: 202 len: 0 microversion: 2.1 time: 0.087642 Aug 10 13:39:04.832620 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 562/1121] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 10 13:39:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-361078310 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:39:05.188745 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:05.189672 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:05.196234 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:05.196792 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:05.197325 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:05.198133 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:05.198588 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:05.199013 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:05.264132 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:05.272446 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-39f9282a-a4d7-426a-9288-d925367a702f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1142 microversion: 2.1 time: 0.087643 Aug 10 13:39:05.276767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 560/1122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:05 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1142 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:06.293732 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:06.294341 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:06.301813 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:06.302327 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:06.302761 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:06.303482 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:06.303935 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:06.304355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:06.438109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:06.447757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-c52b86ae-7780-4a83-ad88-d32c1ecbac8d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1208 microversion: 2.1 time: 0.157705 Aug 10 13:39:06.448582 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 563/1123] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:06 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1208 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:07.475633 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:07.476227 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:07.482566 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:07.483116 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:07.483483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:07.485466 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:07.486529 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:07.486971 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:07.554714 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:07.562757 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-38243df0-501a-4480-8f57-545c0cfe8ab4 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1208 microversion: 2.1 time: 0.090889 Aug 10 13:39:07.563331 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 561/1124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:07 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:08.583650 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:08.584466 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:08.593401 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:08.597772 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:08.598396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:08.599597 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:08.600607 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:08.601178 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:08.821795 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:08.829784 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-890580ac-28f8-4e10-9d06-94e6bb499286 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.250177 Aug 10 13:39:08.831475 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 564/1125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:08 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:08.969977 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-51b0625e-b28e-47b6-9207-0eae442b6c41 req-19be25f6-5798-4cce-a295-d6604e0115e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5ee936-89b3-4c07-a51f-03bb3ca7e497", "tag": "7d209737-19b2-4654-96f2-dca72895d1cd"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:08.986561 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-51b0625e-b28e-47b6-9207-0eae442b6c41 req-19be25f6-5798-4cce-a295-d6604e0115e7 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:08.987635 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-51b0625e-b28e-47b6-9207-0eae442b6c41 req-19be25f6-5798-4cce-a295-d6604e0115e7 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:08.988342 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-51b0625e-b28e-47b6-9207-0eae442b6c41 req-19be25f6-5798-4cce-a295-d6604e0115e7 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:09.006890 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-51b0625e-b28e-47b6-9207-0eae442b6c41 req-19be25f6-5798-4cce-a295-d6604e0115e7 service nova] Creating event network-changed:7d209737-19b2-4654-96f2-dca72895d1cd for instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 on hv-cinder-83602 Aug 10 13:39:09.012130 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-51b0625e-b28e-47b6-9207-0eae442b6c41 req-19be25f6-5798-4cce-a295-d6604e0115e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049312 Aug 10 13:39:09.012721 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 562/1126] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:39:09.851790 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:09.852326 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:09.859564 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:09.860192 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:09.860629 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:09.861362 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:09.861822 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:09.862248 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:10.128307 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:10.136849 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-b17dc085-00dd-4ad7-b0da-e60e7b2a6035 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.288962 Aug 10 13:39:10.150518 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 565/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:09 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:11.159485 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:11.160422 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:11.167010 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:11.167487 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:11.167919 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:11.168602 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:11.169079 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:11.169501 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:11.302247 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:11.309910 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-529d3cb0-859b-43e0-8c84-19759da11173 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.155219 Aug 10 13:39:11.310562 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 563/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:11 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:12.332352 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:12.333011 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:12.345293 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:12.345793 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:12.346235 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:12.346943 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:12.347403 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:12.347833 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:12.510735 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:12.518679 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5a1fbdc5-643e-46d4-b118-0ae0da40b698 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.191299 Aug 10 13:39:12.519237 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 566/1129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:12 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:13.539803 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:13.540429 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:13.547592 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:13.548073 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:13.548513 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:13.549237 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:13.549691 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:13.550117 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:13.554263 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=2 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:13.574998 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell0:SELECT=6 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:13.786324 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:13.793846 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-b7e29b6f-f5b4-40f8-8702-d0257377a14a tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.258126 Aug 10 13:39:13.794416 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 564/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:13 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:14.816301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:14.816874 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:14.820296 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell0:SELECT=2 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:14.823776 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:14.824254 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:14.824864 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:14.825714 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:14.826166 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:14.826878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:14.990712 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:14.998280 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-13cd31cb-1eec-4bcd-a6d0-755e400cca41 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.186804 Aug 10 13:39:14.998846 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 567/1131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:14 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:16.020494 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:16.021135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:16.027517 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:16.027994 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:16.028427 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:16.029145 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:16.029618 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:16.030039 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:16.165274 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:16.173967 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-cf40fc1d-b867-44a1-9dc7-f1b83b6830e3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.157359 Aug 10 13:39:16.174535 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 565/1132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:16 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:17.195311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:17.195944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:17.201998 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:17.202878 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:17.203374 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:17.204053 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:17.204516 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:17.204933 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:17.335814 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:17.344027 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-68349d8c-eed3-4eee-b8e7-630fe273f5cf tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.152336 Aug 10 13:39:17.344613 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 568/1133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:17 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:18.364882 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:18.365526 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:18.371509 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:18.371993 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:18.372431 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:18.373154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:18.373608 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:18.374574 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:18.505898 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:18.514118 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e8af058b-0bed-4738-9d91-68e8050a298e tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.153295 Aug 10 13:39:18.515289 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 566/1134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:18 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:19.535036 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:19.535678 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:19.542127 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:19.542602 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:19.543034 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:19.543715 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:19.544165 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:19.544586 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:19.685177 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:19.691666 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-cc641d05-0050-4f31-ab34-05c033407906 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.160850 Aug 10 13:39:19.692238 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 569/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:19 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:20.151542 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-630c1e53-0474-4b6a-b669-2dd8fa80842b req-67b85b02-99a1-41ec-a09b-61907f688705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5ee936-89b3-4c07-a51f-03bb3ca7e497", "name": "network-vif-plugged", "status": "completed", "tag": "7d209737-19b2-4654-96f2-dca72895d1cd"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:20.162219 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-630c1e53-0474-4b6a-b669-2dd8fa80842b req-67b85b02-99a1-41ec-a09b-61907f688705 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:20.162702 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-630c1e53-0474-4b6a-b669-2dd8fa80842b req-67b85b02-99a1-41ec-a09b-61907f688705 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:20.163135 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-630c1e53-0474-4b6a-b669-2dd8fa80842b req-67b85b02-99a1-41ec-a09b-61907f688705 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:20.174816 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-630c1e53-0474-4b6a-b669-2dd8fa80842b req-67b85b02-99a1-41ec-a09b-61907f688705 service nova] Creating event network-vif-plugged:7d209737-19b2-4654-96f2-dca72895d1cd for instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 on hv-cinder-83602 Aug 10 13:39:20.179643 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-630c1e53-0474-4b6a-b669-2dd8fa80842b req-67b85b02-99a1-41ec-a09b-61907f688705 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031819 Aug 10 13:39:20.180221 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 567/1136] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:20.713212 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:20.713835 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:20.720324 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:20.720808 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:20.721288 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:20.721979 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:20.722437 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:20.723477 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:20.853810 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:20.861665 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9197c18f-eac0-42bb-889b-e479765f2c14 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.152473 Aug 10 13:39:20.862222 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 570/1137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:20 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:21.883560 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:21.884279 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:21.891472 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:21.891952 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:21.892397 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:21.893119 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:21.893575 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:21.893999 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:22.033327 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:22.041119 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-f93ff1a4-4305-40c7-a762-396fa851f369 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1263 microversion: 2.1 time: 0.162363 Aug 10 13:39:22.041678 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 568/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:21 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:23.061208 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:23.062052 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:23.068137 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:23.068611 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:23.069065 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:23.069747 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:23.070193 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:23.070609 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:23.209758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:23.217202 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-09886f91-a56f-4d28-a01c-ba65b91f0395 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1450 microversion: 2.1 time: 0.159806 Aug 10 13:39:23.218505 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 571/1139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:23 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:23.237822 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:23.243087 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:23.244799 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:23.245316 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:23.245761 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:23.246457 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:23.246916 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:23.247343 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:23.376453 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:23.383961 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-aa3d0f12-c7d5-4890-8ba3-0120b4963b69 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1450 microversion: 2.1 time: 0.150032 Aug 10 13:39:23.384514 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 569/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:23 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:25.428816 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-aa76b99c-e178-4b0b-8bad-9e8c6647407b req-47016da2-bdeb-4096-a960-b5704dd0168d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5ee936-89b3-4c07-a51f-03bb3ca7e497", "tag": "7d209737-19b2-4654-96f2-dca72895d1cd"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:25.440257 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-aa76b99c-e178-4b0b-8bad-9e8c6647407b req-47016da2-bdeb-4096-a960-b5704dd0168d service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:25.440819 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-aa76b99c-e178-4b0b-8bad-9e8c6647407b req-47016da2-bdeb-4096-a960-b5704dd0168d service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:25.441343 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-aa76b99c-e178-4b0b-8bad-9e8c6647407b req-47016da2-bdeb-4096-a960-b5704dd0168d service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:25.452266 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-aa76b99c-e178-4b0b-8bad-9e8c6647407b req-47016da2-bdeb-4096-a960-b5704dd0168d service nova] Creating event network-changed:7d209737-19b2-4654-96f2-dca72895d1cd for instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 on hv-cinder-83602 Aug 10 13:39:25.457901 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-aa76b99c-e178-4b0b-8bad-9e8c6647407b req-47016da2-bdeb-4096-a960-b5704dd0168d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215526 Aug 10 13:39:25.458752 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 572/1141] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:11.033679 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:40:11.034306 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Wed Aug 10 13:40:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:40:36.664541 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:40:36.665087 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:40:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:41:05.119211 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:05.120248 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG dbcounter [-] [118002] Writing DB stats nova_cell1:SELECT=76 {{(pid=118002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:05.122511 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:05.123705 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG dbcounter [-] [118003] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:05.124471 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:05.125259 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:05.129272 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [req-1bfe0d05-9a39-4a30-b472-5a8e5cb424c2 req-1c99da20-e5dc-4c2a-88ba-48faa3146a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5ee936-89b3-4c07-a51f-03bb3ca7e497", "tag": "7d209737-19b2-4654-96f2-dca72895d1cd"}]} {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:05.134520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:05.134520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:05.134520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:05.134520 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:05.134967 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:05.134967 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:05.139872 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1bfe0d05-9a39-4a30-b472-5a8e5cb424c2 req-1c99da20-e5dc-4c2a-88ba-48faa3146a9b service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:05.141206 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1bfe0d05-9a39-4a30-b472-5a8e5cb424c2 req-1c99da20-e5dc-4c2a-88ba-48faa3146a9b service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:05.142217 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [req-1bfe0d05-9a39-4a30-b472-5a8e5cb424c2 req-1c99da20-e5dc-4c2a-88ba-48faa3146a9b service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:05.153960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.compute.server_external_events [req-1bfe0d05-9a39-4a30-b472-5a8e5cb424c2 req-1c99da20-e5dc-4c2a-88ba-48faa3146a9b service nova] Creating event network-changed:7d209737-19b2-4654-96f2-dca72895d1cd for instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 on hv-cinder-83602 Aug 10 13:41:05.160734 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [req-1bfe0d05-9a39-4a30-b472-5a8e5cb424c2 req-1c99da20-e5dc-4c2a-88ba-48faa3146a9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040642 Aug 10 13:41:05.164236 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 573/1142] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:05.164681 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Going to try to terminate instance {{(pid=118002) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:41:05.435469 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-55ae1f8b-3db6-4c5e-b154-a827d92bc3f8 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 204 len: 0 microversion: 2.1 time: 0.318000 Aug 10 13:41:05.436364 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 570/1143] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:41:05 2022] DELETE /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:41:05.445041 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:05.445816 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:05.454136 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:05.454626 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:05.455060 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:05.455757 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:05.456207 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:05.457227 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:05.594557 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:05.602930 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-d220e217-1bfd-49f2-89dc-bee6c91c183c tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1575 microversion: 2.1 time: 0.162282 Aug 10 13:41:05.603505 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 574/1144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:05 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:06.625483 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:06.626191 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:06.633155 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:06.633634 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:06.634066 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:06.634749 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:06.635242 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:06.635669 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:06.778297 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:06.786842 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-a2d04f32-5294-48e8-a582-ad32cdcc6260 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1575 microversion: 2.1 time: 0.166839 Aug 10 13:41:06.787524 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 571/1145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:06 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:07.809410 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:07.810028 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:07.817758 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:07.818247 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:07.818695 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:07.819392 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:07.819848 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:07.820274 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:08.030454 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-b5065e5f-96ad-4e83-8fe5-0acf47aa7f08 req-9ceadf12-13c3-4b99-98b3-1a2e72507fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5ee936-89b3-4c07-a51f-03bb3ca7e497", "name": "network-vif-deleted", "tag": "7d209737-19b2-4654-96f2-dca72895d1cd"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:08.042367 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b5065e5f-96ad-4e83-8fe5-0acf47aa7f08 req-9ceadf12-13c3-4b99-98b3-1a2e72507fb0 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:08.042959 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b5065e5f-96ad-4e83-8fe5-0acf47aa7f08 req-9ceadf12-13c3-4b99-98b3-1a2e72507fb0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:08.043385 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b5065e5f-96ad-4e83-8fe5-0acf47aa7f08 req-9ceadf12-13c3-4b99-98b3-1a2e72507fb0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:08.046385 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:08.054670 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-307d5c42-eb0b-4f22-853b-2f5762dd7e18 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1456 microversion: 2.1 time: 0.250197 Aug 10 13:41:08.055242 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 575/1146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:07 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1456 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:08.055920 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-b5065e5f-96ad-4e83-8fe5-0acf47aa7f08 req-9ceadf12-13c3-4b99-98b3-1a2e72507fb0 service nova] Creating event network-vif-deleted:7d209737-19b2-4654-96f2-dca72895d1cd for instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 on hv-cinder-83602 Aug 10 13:41:08.061223 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-b5065e5f-96ad-4e83-8fe5-0acf47aa7f08 req-9ceadf12-13c3-4b99-98b3-1a2e72507fb0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034525 Aug 10 13:41:08.061868 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 572/1147] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:41:09.076822 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:09.077476 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:09.083922 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.084409 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.084853 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.085576 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.086036 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.086465 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.118461 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.118944 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.119386 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.119838 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.objects.instance [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lazy-loading 'fault' on Instance uuid 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 {{(pid=118003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:41:09.165204 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:09.173275 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-da7ce5fa-49b4-4940-b935-6484cdb52393 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 200 len: 1228 microversion: 2.1 time: 0.100312 Aug 10 13:41:09.173845 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 576/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:09 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 1228 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:10.195933 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:10.196649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 4a5ee936-89b3-4c07-a51f-03bb3ca7e497] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:10.203625 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:10.204136 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:10.204569 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:10.205280 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:10.205728 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:10.206147 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:10.219922 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] HTTP exception thrown: Instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 could not be found. Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Request method failure captured: Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 HTTP/1.1 Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87O3CToxm41lD_dw4CCjemPHpXXw_xr1Xkn2fNZchzljgDVzwVzPkVAQtgLIA59VZPzTqyDl1E2NjPiZXInf6ywxlRVFzsvqUHjItZZjoX7wdyXOo7ez5zM4tlE5UQVK7bO5XhBm3h_A3BK3SfgbZ1UdHwO_VL5YCkTFAWxz8TYKsng Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:41:10.221549 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ded676e84f4145d5912a3878ef9af132", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 9675d83e26b647489e4b6195bb814aab Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 could not be found. Aug 10 13:41:10.223311 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '4a5ee936-89b3-4c07-a51f-03bb3ca7e497'} Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 could not be found. Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:41:10.224335 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 could not be found. Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 could not be found. Aug 10 13:41:10.226085 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:10.227661 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Returning 404 to user: Instance 4a5ee936-89b3-4c07-a51f-03bb3ca7e497 could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:41:10.227661 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-1efe3896-3845-47be-874e-45959abc0688 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497" status: 404 len: 111 microversion: 2.1 time: 0.031225 Aug 10 13:41:10.227661 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 573/1149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:10 2022] GET /compute/v2.1/servers/4a5ee936-89b3-4c07-a51f-03bb3ca7e497 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:41:13.800516 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-b88c1daf-bf99-4c68-b7a3-310783ab3e9a req-8dd0b0d0-1625-4f41-bb55-d902d53414f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7117f6d5-204e-41fb-93cc-bbf6038d9f59", "tag": "b1e40f7b-f66b-468c-9f7b-93199f918abf"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:13.801216 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:13.801590 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:13.808335 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:13.820328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:13.820328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:13.820328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:13.820328 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:13.820731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:13.820827 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b88c1daf-bf99-4c68-b7a3-310783ab3e9a req-8dd0b0d0-1625-4f41-bb55-d902d53414f0 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:13.820827 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b88c1daf-bf99-4c68-b7a3-310783ab3e9a req-8dd0b0d0-1625-4f41-bb55-d902d53414f0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:13.820827 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-b88c1daf-bf99-4c68-b7a3-310783ab3e9a req-8dd0b0d0-1625-4f41-bb55-d902d53414f0 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:13.826314 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-b88c1daf-bf99-4c68-b7a3-310783ab3e9a req-8dd0b0d0-1625-4f41-bb55-d902d53414f0 service nova] Creating event network-changed:b1e40f7b-f66b-468c-9f7b-93199f918abf for instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 on hv-cinder-83602 Aug 10 13:41:13.832571 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-b88c1daf-bf99-4c68-b7a3-310783ab3e9a req-8dd0b0d0-1625-4f41-bb55-d902d53414f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039248 Aug 10 13:41:13.833187 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 574/1150] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:13.839843 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Going to try to terminate instance {{(pid=118003) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:41:14.185817 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-5ad61365-05b3-4dec-a7ba-7a4cde802f2d tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 204 len: 0 microversion: 2.1 time: 0.394639 Aug 10 13:41:14.186605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 577/1151] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:41:13 2022] DELETE /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:41:14.195720 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:14.196409 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:14.203400 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:14.203889 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:14.211783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:14.211783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:14.211783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:14.211783 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:14.350701 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:14.358201 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e6324d0d-37c6-44c4-b121-7e7ad69bc05f tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1576 microversion: 2.1 time: 0.166610 Aug 10 13:41:14.359540 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 575/1152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:14 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:15.381605 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:15.382301 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:15.388798 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:15.389311 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:15.389748 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:15.390439 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:15.390898 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:15.391323 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:15.566408 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:15.573960 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-62986c4a-ceb5-4f56-a684-aa8d9d504213 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1576 microversion: 2.1 time: 0.196600 Aug 10 13:41:15.574536 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 578/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:15 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:16.441508 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [req-a15fd0e0-08aa-4633-b36b-0a6265e77aa6 req-5b00a909-d26d-4d6d-932f-d84afdaf2aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7117f6d5-204e-41fb-93cc-bbf6038d9f59", "name": "network-vif-deleted", "tag": "b1e40f7b-f66b-468c-9f7b-93199f918abf"}]} {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:16.451190 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-a15fd0e0-08aa-4633-b36b-0a6265e77aa6 req-5b00a909-d26d-4d6d-932f-d84afdaf2aa9 service nova] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:16.451670 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-a15fd0e0-08aa-4633-b36b-0a6265e77aa6 req-5b00a909-d26d-4d6d-932f-d84afdaf2aa9 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:16.452094 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [req-a15fd0e0-08aa-4633-b36b-0a6265e77aa6 req-5b00a909-d26d-4d6d-932f-d84afdaf2aa9 service nova] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:16.462918 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.compute.server_external_events [req-a15fd0e0-08aa-4633-b36b-0a6265e77aa6 req-5b00a909-d26d-4d6d-932f-d84afdaf2aa9 service nova] Creating event network-vif-deleted:b1e40f7b-f66b-468c-9f7b-93199f918abf for instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 on hv-cinder-83602 Aug 10 13:41:16.467576 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [req-a15fd0e0-08aa-4633-b36b-0a6265e77aa6 req-5b00a909-d26d-4d6d-932f-d84afdaf2aa9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029893 Aug 10 13:41:16.468141 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 576/1154] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:16.596526 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:16.597346 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:16.603649 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:16.604123 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:16.604553 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:16.605250 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:16.605725 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:16.606155 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:16.669413 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.policy [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118003) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:16.677326 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-9e27ebe1-22c9-45e0-86f2-a85dc7905b51 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1224 microversion: 2.1 time: 0.085372 Aug 10 13:41:16.677889 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 579/1155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:16 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:17.699274 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:17.699978 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:17.707599 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.708657 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.708914 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.709649 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.710115 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.710557 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.744433 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.744911 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.745368 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.745807 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.objects.instance [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lazy-loading 'fault' on Instance uuid 7117f6d5-204e-41fb-93cc-bbf6038d9f59 {{(pid=118002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:41:17.787492 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.policy [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9675d83e26b647489e4b6195bb814aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded676e84f4145d5912a3878ef9af132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:17.794984 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-2bbd7394-dd36-4258-95bb-4de2419f5c20 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 200 len: 1229 microversion: 2.1 time: 0.100818 Aug 10 13:41:17.795541 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 577/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:17 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:18.822549 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:18.823156 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 7117f6d5-204e-41fb-93cc-bbf6038d9f59] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:18.829095 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:18.829574 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:18.830030 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:18.831282 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:18.831731 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:18.832147 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:18.845224 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] HTTP exception thrown: Instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 could not be found. Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Request method failure captured: Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 HTTP/1.1 Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87O3CToxm41lD_dw4CCjemPHpXXw_xr1Xkn2fNZchzljgDVzwVzPkVAQtgLIA59VZPzTqyDl1E2NjPiZXInf6ywxlRVFzsvqUHjItZZjoX7wdyXOo7ez5zM4tlE5UQVK7bO5XhBm3h_A3BK3SfgbZ1UdHwO_VL5YCkTFAWxz8TYKsng Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:41:18.846880 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ded676e84f4145d5912a3878ef9af132", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 9675d83e26b647489e4b6195bb814aab Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 could not be found. Aug 10 13:41:18.848719 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '7117f6d5-204e-41fb-93cc-bbf6038d9f59'} Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 could not be found. Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:41:18.852364 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 could not be found. Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 could not be found. Aug 10 13:41:18.854109 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:18.856061 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Returning 404 to user: Instance 7117f6d5-204e-41fb-93cc-bbf6038d9f59 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:41:18.856061 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-7251708b-db18-41cf-96e8-099fa79e31f3 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59" status: 404 len: 111 microversion: 2.1 time: 0.029810 Aug 10 13:41:18.856061 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 580/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:18 2022] GET /compute/v2.1/servers/7117f6d5-204e-41fb-93cc-bbf6038d9f59 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:41:19.353880 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:19.354367 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.compute.api [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118002) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:19.360708 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:19.361249 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:19.362349 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:19.363124 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:19.363586 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:19.364018 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG oslo_concurrency.lockutils [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:19.377798 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.wsgi [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] HTTP exception thrown: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Request method failure captured: Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: request: DELETE /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 HTTP/1.1 Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept: application/json Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Accept-Encoding: identity Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Connection: close Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Length: 0 Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Content-Type: application/json Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Host: 10.222.0.40 Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Openstack-System-Scope: None Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: User-Agent: python-urllib3/1.26.11 Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Auth-Token: gAAAAABi87O3CToxm41lD_dw4CCjemPHpXXw_xr1Xkn2fNZchzljgDVzwVzPkVAQtgLIA59VZPzTqyDl1E2NjPiZXInf6ywxlRVFzsvqUHjItZZjoX7wdyXOo7ez5zM4tlE5UQVK7bO5XhBm3h_A3BK3SfgbZ1UdHwO_VL5YCkTFAWxz8TYKsng Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Id: None Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Domain-Name: None Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Identity-Status: Confirmed Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Is-Admin-Project: True Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Id: default Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Domain-Name: Default Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Project-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Role: member,reader Aug 10 13:41:19.379441 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Roles: member,reader Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ded676e84f4145d5912a3878ef9af132", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Id: default Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Domain-Name: Default Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Id: 9675d83e26b647489e4b6195bb814aab Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: X-User-Name: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: method: > Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: exception: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.381154 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: action_args: {'id': '42768bb4-b1d6-48d4-a5b2-18a563b02c22'} Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:41:19.382032 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.383403 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.384907 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Returning 404 to user: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. {{(pid=118002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:41:19.384907 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e500e6a9-3002-4cae-b90e-a2f31b055eb5 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 404 len: 111 microversion: 2.1 time: 0.030885 Aug 10 13:41:19.384907 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 578/1158] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 10 13:41:19 2022] DELETE /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:41:19.389480 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '>' {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:19.390097 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.compute.api [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] [instance: 42768bb4-b1d6-48d4-a5b2-18a563b02c22] Fetching instance by UUID {{(pid=118003) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:19.396703 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:19.397230 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:19.397672 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:19.398360 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Acquiring lock "372f88b7-cf72-43dd-a32b-705a4ede3130" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:19.398813 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:19.399239 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG oslo_concurrency.lockutils [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Lock "372f88b7-cf72-43dd-a32b-705a4ede3130" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:19.413121 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.wsgi [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] HTTP exception thrown: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Request method failure captured: Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: request: GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 HTTP/1.1 Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept: application/json Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Accept-Encoding: identity Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Connection: close Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Length: 0 Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Content-Type: application/json Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Host: 10.222.0.40 Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Openstack-System-Scope: None Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: User-Agent: python-urllib3/1.26.11 Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Auth-Token: gAAAAABi87O3CToxm41lD_dw4CCjemPHpXXw_xr1Xkn2fNZchzljgDVzwVzPkVAQtgLIA59VZPzTqyDl1E2NjPiZXInf6ywxlRVFzsvqUHjItZZjoX7wdyXOo7ez5zM4tlE5UQVK7bO5XhBm3h_A3BK3SfgbZ1UdHwO_VL5YCkTFAWxz8TYKsng Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Id: None Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Domain-Name: None Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Identity-Status: Confirmed Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Is-Admin-Project: True Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Id: default Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Domain-Name: Default Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Project-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Role: member,reader Aug 10 13:41:19.414624 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Roles: member,reader Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ded676e84f4145d5912a3878ef9af132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ded676e84f4145d5912a3878ef9af132", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Id: ded676e84f4145d5912a3878ef9af132 Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-Tenant-Name: tempest-TestVolumeBootPattern-1918269673 Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Id: default Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Domain-Name: Default Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Id: 9675d83e26b647489e4b6195bb814aab Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: X-User-Name: tempest-TestVolumeBootPattern-1918269673-project Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: method: > Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: exception: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.416313 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: action_args: {'id': '42768bb4-b1d6-48d4-a5b2-18a563b02c22'} Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: {{(pid=118003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:41:19.417285 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. Aug 10 13:41:19.418851 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: ERROR nova.api.openstack.wsgi Aug 10 13:41:19.420355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: DEBUG nova.api.openstack.wsgi [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Returning 404 to user: Instance 42768bb4-b1d6-48d4-a5b2-18a563b02c22 could not be found. {{(pid=118003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:41:19.420355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO nova.api.openstack.requestlog [None req-04e98a7c-2f32-442c-a1b6-b9055369d521 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22" status: 404 len: 111 microversion: 2.1 time: 0.030351 Aug 10 13:41:19.420355 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: [pid: 118003|app: 0|req: 581/1159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:19 2022] GET /compute/v2.1/servers/42768bb4-b1d6-48d4-a5b2-18a563b02c22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:41:20.915598 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: DEBUG nova.api.openstack.wsgi [None req-e2541466-0d21-4758-81d6-92acc83c8030 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] Calling method '.version_select at 0x7ff6a37d2b80>' {{(pid=118002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:21.000623 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO nova.api.openstack.requestlog [None req-e2541466-0d21-4758-81d6-92acc83c8030 tempest-TestVolumeBootPattern-1918269673 tempest-TestVolumeBootPattern-1918269673-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-533191636" status: 202 len: 0 microversion: 2.1 time: 0.088858 Aug 10 13:41:21.001252 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: [pid: 118002|app: 0|req: 579/1160] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Aug 10 13:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-533191636 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:42:09.254543 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:42:09.255143 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:42:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:42:13.763264 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:42:13.763767 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Wed Aug 10 13:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:43:56.672684 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:43:56.673157 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:43:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:44:06.762811 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:44:06.763396 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:44:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:44:14.748933 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:44:14.749473 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Wed Aug 10 13:44:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:45:29.262739 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:45:29.263370 dv-cinder-836027-5-iscsi devstack@n-api.service[118003]: Wed Aug 10 13:45:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:45:33.772835 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:45:33.773380 dv-cinder-836027-5-iscsi devstack@n-api.service[118002]: Wed Aug 10 13:45:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!